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(54) Picture coding apparatus and decoding apparatus 

(57) Representative picture extracting means 102 
extracts representative pictures from a coded input sig- 
nal 101 which consists of representative pictures, motion 
parameters for motion compensation which refers the 
representative picture, and reference relationships, and 
outputs a coded representative picture signal 103. The 
signal is decoded by a representative picture decoding 
means 104, and output as a decoded representative pic- 
ture signal 1 05 to a delay memory 1 06. On the other and, 
representative picture reference relationship extracting 

Fig. 1 



means 112 extracts reference relationship additional 
information 113, and outputs it to decoded signal output 
controlling means 114. The sequence of outputting the 
representative pictures is determined on the basis of the 
reference relationship additional information 1 13. and an 
output control signal 1 15 is output to the delay memory 

1 06, The delay memory 1 06 outputs the decoded repre- 
sentative picture signal 105 as a decoded output signal 

107, on the basis of the output control signal 1 15. 
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Description 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates to a picturexodirrg apparatus 
and a decoding apparatus which, when a video signal is 
to be encoded and decoded for storage or transmission, 
can realize high efficiency coding, and also a high speed 
search or reproduction of excellent efficiency. 

2. Related Art of the Invention 

Recently, MPEG (Moving Picture Expert Group) 
which is an international standard is typical of video cod- 
ing. 

According to MPEG, intrapicture coding is first con- 
ducted, motion vectors of a P-frame or a B-frame are 
detected on the basis of the intrapicture-decoded picture 
(l-frame) corresponding to the coding, motion compen- 
sation prediction of the detected motion vectors is con- 
ducted based on the motion vectors, and a difference 
between a motion compensated picture obtained by the 
motion compensation and the picture to be encoded is 
encoded. Namely, MPEG is a coding method of the 
intrapicture/interpicture selection type in which the 
intrapicture-decoded picture and the intrapicture coding 
of the picture are combined with each other. 

In a coding method of the intrapicture/interpicture 
selection type, in order to prevent error propagation from 
occurring or enable an encoded picture to be reproduced 
from the middle irrespective of the contents of a moving 
picture, intrapicture coding is conducted with a predeter- 
mined period. When a moving picture is to be subjected 
to high speed reproduction, therefore, only a picture 
which has undergone intrapicture coding is extracted 
and then decoded to obtain a reproduced picture. 

Fig. 1 0 is a block diagram of a high-speed reproduc- 
tion apparatus in which an intrapicture-coded picture is 
extracted and then decoded. In the figure, 1 designates 
a coded input signal, 2 designates intrapicture-coded 
picture extracting means, 3 designates an intrapicture- 
coded signal, 4 designates intrapicture-coded picture 
decoding means, and 5 designates a decoded output 
signal. 

The operation of the thus configured high-speed 
reproduction apparatus will be described. The intrapi- 
cture-coded picture extracting means 2 extracts only a 
picture which has undergone intrapicture coding, from 
the coded input signal 1 which has been subjected to 
coding of the intrapicture/interpicture selection type, and 
outputs the intrapicture-coded signal 3. The intrapicture- 
coded picture decoding means 4 decodes the intrapi- 
cture-coded signal 3 and outputs the decoded output sig- 
nal 5. In this way, high-speed reproduction is conducted 
by extracting only an intrapicture-coded picture and 
decoding it. 
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In the high-speed reproduction apparatus, however, 
a P-frame or B-frame cannot be used in high-speed 
reproduction unless a l-frame or P-frame which is to be 
referred is decoded. Consequently, it is difficult to pro- 
duce a high-speed reproduction apparatus which can 
smoothly conduct high-speed rQ p r ™j[jjrtr" - 

Even when only a part of a picture is updated, more- 
over, the previous picture must be updated. This causes 
the amount of information to be processed for high- 
speed reproduction, to be increased. 

Since reproduction is performed at f ixed intervals, it 
is difficult to conduct high-speed reproduction or a high- 
speed scene search in accordance with a change in con- 
tents of a picture. 

Coding of pixel value information for a conventional 
picture scene is conducted on a single layer. In other 
words, pixel value information of the whole contents of 
one scene of a picture are completed on a single layer, 
and coding is conducted on each of the pixel value infor- 
mation on the single layer. When pixel value information 
which is completed on a single layer is to be encoded, 
the need fa efficiently conducting the coding is growingly 
increased. 

However, conventional means for encoding pixel 
value information which is completed on a single layer 
has a problem in that, even when a pixel which is not 
required to be encoded exists in the single layer, coding 
must be conducted with considering the value of the pixel 
and therefore the amount of information to be encoded 
is increased so that the processing speed is reduced. 

Summary of the Invention 



According to the invention, a technique of layered 
35 coding is employed in which a moving picture is sepa- 
rated into layers such as a background, a foreground, 
and characters or pictures are separately prepared as 
one layer and coding is conducted on each layer. As a 
novel technique of coding a moving picture, the inventors 
40 have proposed in another patent application a technique 
of layered coding which uses a representative picture 
structure and global motion compensation. 

Fig. 11(a) is a diagram illustrating a layered struc- 
ture. A final output picture is generated by synthesizing 
45 a foreground layer with a background layer. In each layer, 
coding is conducted by using a representative picture 
(template) structure and global motion compensation. 
Global motion compensation is a method in which motion 
of the whole picture is represented by global motion 
so parameters such as translation, rotation, zooming, and 
reduction, motion compensation is conducted, and a pre- 
dictive coded picture is generated. In the method, a pre- 
dictive differential signal may be encoded or predictive 
differential signal coding may be omitted. 
55 Fig. 1 1 (b) is a diagram illustrating the representative 
picture structure. Each layer is tracked along the time 
series, and a picture which represents each scene is 
selected as a representative picture. Examples of select- 
ing a representative picture are listed below: 
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1 . A picture which, in motion compensation, exhibits 
a minimum differential signal after motion compen- 
sation is selected. 

2. A picture which is easy to search in a search proc- 
ess is artificially selected. s 

3. The first picture in a scene is selected. 

In each scene, global motion compensation is con- 
ducted while using the representative picture of the 
scene as the reference picture, and a predictive coded 10 
picture is generated. As the representative picture to be 
referred, a representative picture of the scene, or a pic- 
ture which has been selected as the representative pic- 
ture in a previous scene may be selected. In other words, 
there is a possibility that the same representative picture is 
is referred in a plurality of scenes. Such a scene may be 
a scene between scene changes in a picture, or a small 
scene which is obtained by partitioning in accordance 
with the groups of motions of the object. Alternatively, the 
scene may be deemed as a scene which is united in con- 20 
tents of a picture. 

To comply with this, it is an object of the invention to 
provide a picture coding apparatus and a decoding appa- 
ratus for the coding apparatus which can conduct a 
search or reproduction wherein stress is placed on rap- 25 
idness or wherein stress is placed on rapidness and also 
on continuity. 

It is another object of the invention to provide a pic- 
ture coding apparatus and a decoding apparatus for the 
coding apparatus which can efficiently encode and 30 
decode a picture signal. 

Specifically, an object of the invention is to provide 
a picture decoding apparatus which can conduct high 
speed reproduction rapidly and efficiently with using a 
representative picture structure and a layered structure 35 
in layered coding which uses a representative picture 
structure and global motion compensation. 

In the picture coding apparatus of the invention, even 
when the same representative picture is referred plural 
times in a plurality of scenes in the case where a coded 40 
signal consisting of representative pictures representing 
scenes of a picture and predictive coded pictures refer- 
ring the representative pictures is to be encoded, refer- 
ence relationships are encoded as additional 
information, and therefore it is possible to realize high- as 
efficiency coding in which waste such as duplication of 
encoding the same representative picture is eliminated. 
In addition to the reference relationships, significance in 
contents of the time series of representative pictures 
may be encoded so that, in decoding associated with a so 
high speed search or high speed reproduction, only a 
representative picture of higher significance is allowed 
to be decoded only by referring additional information of 
higher significance. 

In the picture decoding apparatus of the invention, ss 
when a coded signal consisting of representative pic- 
tures representing scenes of a picture and predictive 
coded pictures referring the representative pictures is to 
be decoded, only a coded representative picture signal 
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is extracted from a coded input signal by representative 
picture extracting means and then decoded by repre- 
sentative picture decoding means. Since only a repre- 
sentative picture signal is subjected to decoding, high- 
speed reproduction can be realized. Since a represent - 
ative picture signal is ^rlrrtrrjjn nfrrordhnnr with a large 
change of a picture, the selected signal corresponds to 
a scene change of a picture. Therefore, high speed 
reproduction or scene search of excellent efficiency 
which reflects the picture contents is enabled only by 
tracking representative pictures. 

In the picture decoding apparatus of the invention, 
when a coded signal consisting of representative pic- 
tures representing scenes of a picture and predictive 
coded pictures referring the representative pictures is to 
be decoded, significance of a representative picture in a 
time series of a picture is set in decreasing order of sig- 
nificance in contents, representative picture extracting 
means extracts a representative picture in consideration 
of significance, and only a representative picture of 
higher significance is decoded. Since significance is con- 
sidered, it is possible to omit decoding of a representa- 
tive picture which is not important in contents. Therefore, 
high speed reproduction or search of more excellent effi- 
ciency is enabled. 

In the picture decoding apparatus of the invention, 
when a coded signal consisting of representative pic- 
tures representing scenes of a picture and predictive 
coded pictures referring the representative pictures is to 
be decoded, high speed reproduction is performed by 
conducting not only decoding of a representative picture 
but also a part of a predictive coded signal referring a 
representative picture signal. It is sufficient for decoding 
of a predictive coded signal to decode a representative 
picture signal to be referred and global motion parame- 
ters. Since high speed reproduction is performed while 
decoding a part of a predictive coded signal, it is possible 
to realize high speed reproduction which complies with 
the picture contents and in which motion is relatively 
smooth. 

In the picture decoding apparatus of the invention, 
when a coded signal consisting of representative pic- 
tures representing scenes of a picture and predictive 
coded picture referring the representative pictures is to 
be decoded, the time interval between adjacent repre- 
sentative picture signals, namely, predictive coded pic- 
tures existing between representative picture signals is 
counted. The coded signal is decoded while shortening 
the representative picture interval to a time interval which 
is proportional to the number of the predictive coded pic- 
tures, and then output, thereby realizing high speed 
reproduction which maintains the original smoothness in 
the time direction of the picture. 

In the picture coding apparatus of the invention, 
when a picture is to be encoded for each of layers such 
as a background and a foreground, significance in con- 
tents is added to each layer as additional information and 
encoded. In decoding for high speed reproduction or 
scene search, therefore, the significance is referred so 
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that a layer of higher significance is subjected to decod- 
ing which is detailed in contents, and that of lower signif- 
icance is subjected to simplified decoding or refrained 
from being subjected to decoding. 

In the picture decoding apparatus of the invention, s 
in the case where a picture is encoded for each of layers 
such as a background and ^foreground, when decoding 
for high speed reproduction or scene search is to be con- 
ducted, additional information of layer significance of a 
coded signal of each layer which is an input signal is 10 
referred to judge significance. Then a layer of higher sig- 
nificance in contents is subjected to decoding which is 
detailed, and that of lower significance is subjected to 
simplified decoding or refrained from being subjected to 
decoding, thereby realizing decoding in which waste is 15 
eliminated and which enables a high speed scene 
search or reproduction of excellent efficiency. 

In the picture decoding apparatus of the invention, 
in the case where a picture is expressed by a layered 
structure and a coded signal consisting of representative 20 
pictures representing scenes of a picture and predictive 
coded pictures referring the representative pictures is to 
be decoded, when decoding of a representative picture 
signal is newly conducted in layers the number of which 
is larger than a predetermined one by predetermined- 25 
number judging means, the output of a representative 
picture is updated in all layers. Even when coding posi- 
tions of representative pictures in time series in layers 
are different from each other, therefore, it is possible to 
coincide output positions with each other. When the 30 
number of layers is less than the predetermined number, 
the output of a representative picture is not updated. 
Consequently, processing can be simplified. 
( In the picture decoding apparatus of the invention, 
in the case where a picture is expressed by a layered 35 
structure, the method of decoding layer-1 is changed 
from that of decoding layer-2, and the output process is 
performed without synthesizing layers with each other, 
but with switching the output layer, thereby realizing high 
speed reproduction or scene search of excellent effi- 40 
ciency in which functions of high speed reproduction and 
high speed scene search are selected in accordance 
with the picture contents of the layers. Since decoding is 
required to be conducted only in the switched layer, 
decoding in which decoding of a non-selected layer is 45 
omitted or waste is eliminated is enabled. 

Specifically, an object of the invention is to efficiently 
realize coding and decoding in a picture which is 
expressed by a layered structure, with using transpar- 
ency information between layers of the layered structure, so 

In the picture coding apparatus of the invention, cod- 
ing of transparency of a pixel value obtained from a pic- 
ture signal results in most cases in a distribution in which 
the ratio of intermediate level values is small or most ele- 
ments are 0% or 1 00%. When the binarization of trans- ss 
parency is efficiently conducted so that coding of 
intermediate level values is omitted or simplified, there- 
fore, the coding efficiency can be improved. 



078 A2 




In the picture coding apparatus of the invention, 
when the frequency ratio of intermediate level values is 
not small, the part other than that of transparency of 
100% is extracted as one region, and pixels in the one 
region are subjected to a multivaluing process^whereby 
the process of multivalue-eryyyting theTcgion other than 
the one region can be omitted. Consequently, the coding 
efficiency can be improved. 

Specifically, the invention is a picture coding appa- 
ratus which judges for a picture signal on the basis of the 
transparent state of the pixel value whether a pixel region 
is to be encoded or not, and a pixel region to be encoded 
is encoded by a predetermined coding method on the 
basis a pixel to be encoded position signal which is 
obtained by encoding the judgment result. 

In the picture coding apparatus of the invention, a 
picture signal is checked to judge whether a pixel region 
is to be encoded or not, on the basis of the transparent 
state of the pixel value, and a pixel region is to be 
encoded is encoded by a predetermined coding method 
on the basis a pixel to be encoded position signal which 
is obtained by encoding the judgment result. Therefore, 
coding of a pixel region other than the pixel region to be 
encoded can be omitted. Consequently, the invention 
has an advantage that the efficiency of coding can be 
improved. 

To achieve the above objects, the invention provides 
a picture coding apparatus comprising: binarizing means 
(2002) for binarizing transparency information for each 
of pixels of a picture on the basis of a predetermined 
value; binary coding means (2004) for binary-encoding 
the transparency information binarized by the binarizing 
means; judging means (2203) forjudging whether or not 
the transparency information for each of the pixels is to 
be multivalue-encoded on the basis of the transparency 
information, for each of the pixels; and muitivalue coding 
means (2206) for multivalue-encoding the transparency 
information which is judged by the judging means that 
the transparency information is to be multivalue- 
encoded. 

Further, to achieve the above objects, the invention 
provides a picture coding apparatus comprising: judging 
means (3005) for judging whether or not each pixel of a 
picture is to be encoded on the basis of transparency 
information for the pixel; and coding means for encoding 
each pixel which is judged by the judging means that the 
pixel is to be encoded. 

To achieve the above objects, the invention provides 
a picture coding apparatus comprising: representative 
picture selecting means (12) for selecting a representa- 
tive picture from a picture group which includes a plurality 
of pictures; coding means for encoding each of the pic- 
tures which are included in the picture group, with using 
the representative picture; and signal generating means 
(17) for generating a signal including the pictures 
encoded by the coding means, and for generating a sig- 
nal including coding information relating to the represent- 
ative picture which is used for each of the encoded 
pictures included in the signal; the signal generating 
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means being able to separately send the signal including 
the encoded pictures and the signal including the coding 
information relating to the representative picture. 

Further, to achieve the above objects, the invention 
provides a picture decoding apparatus comprising: rep- s 
resentative picture extracting means (102) for extracting 
information relating id^lt orpart of the representative pic- 
tures, from the signal generated by the signal generating 
means (17) of the picture coding apparatus; and repre- 
sentative picture decoding means (104) for decoding the 
representative picture extracted by the representative 
picture extracting means. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages, features, and 
uses will become more apparent as the description pro- 
ceeds, when considered with the accompanying draw- 
ings in which: 

Fig. 1 is a block diagram of a picture coding appara- 
tus which is a first embodiment of the invention; 
Fig. 2 is a block diagram of a picture decoding appa- 
ratus which is a second embodiment of the inven- 
tion; 

Fig. 3 is a block diagram of a picture decoding appa- 
ratus which is a third embodiment of the invention; 
Fig. 4 is a block diagram of a picture decoding appa- 
ratus which is a fourth embodiment of the invention; 
Fig. 5 is a block diagram of a picture decoding appa- 30 
ratus which is a fifth embodiment of the invention; 
Fig. 6 is a block diagram of a picture coding appara- 
tus which is a sixth embodiment of the invention; 
Fig. 7 is a block diagram of a picture decoding appa- 
ratus which is a seventh embodiment of the inven- 35 
tion; 

Fig. 8 is a block diagram of a picture decoding appa- 
ratus which is an eighth embodiment of the inven- 
tion; 

Fig. 9 is a block diagram of a picture decoding appa- 40 
ratus which is a ninth embodiment of the invention; 
Fig. 10 is a block diagram of a conventional high 
speed reproduction apparatus in which an intrapi- 
cture-coded picture is extracted and then decoded; 
Fig. 1 1 (a) is a diagram illustrating a layered structure 45 
in layered coding which uses a representative pic- 
ture and global motion compensation; 
Fig. 1 1(b) is a diagram illustrating a representative 
picture structure in layered coding which uses a rep- 
resentative picture and global motion compensa- so 
tion; 

Fig. 12 is a diagram illustrating the operation of the 
second embodiment; 

Fig. 13 is a diagram illustrating the operation of the 
third embodiment; 55 
Fig. 14 is a diagram illustrating the operation of the 
fifth embodiment; 

Fig. 15 is a diagram illustrating the output updation 
of the eighth embodiment; 



Fig. 16(a) is a blockdiagram relating to a picture cod- 
ing apparatus which is a tenth embodiment of the 
invention; 

Fig. 16(b) is a diagram showing binarization of bina- 

rizing means; _ 

Fig. 1 7 is a bloofHWyyidin uf U picture coding appa- 
ratus which is an eleventh embodiment of the inven- 
tion; 

Fig. 18 is a block diagram of a picture coding appa- 
ratus which is a twelfth embodiment of the invention; 
Rg. 19(a) is a block diagram of a picture coding 
apparatus which is a thirteenth embodiment of the 
invention; 

Rg. 1 9(b) is a diagram showing an example of a gra- 
dient in gradient calculating means; 
Rg. 20(a) is a block diagram of a picture coding 
apparatus which is a fourteenth embodiment of the 
invention; 

Rg. 20(b) is a diagram showing a difference in dif- 
ference calculating means; 
Rg. 21(a) is a block diagram of a picture coding 
apparatus which is a fifteenth embodiment of the 
invention; 

Rg. 21 (b) is a diagram showing an example of a mul- 
tivalue signal 2001; 

Rg. 21(c) is a diagram showing an example of a 
binary signal 2003; 

Rg. 21(d) is a diagram showing an example of a 
binary signal 2403; 

Rg. 22 is a block diagram of a picture coding appa- 
ratus which is a sixteenth embodiment of the inven- 
tion; 

Rg. 23 is a block diagram of a picture coding appa- 
ratus which is a seventeenth embodiment of the 
invention; 

Rg. 24 is a block diagram of a picture decoding 
apparatus which is an eighteenth embodiment of the 
invention; 

Rg. 25 is a block diagram of a picture decoding 
apparatus which is a nineteenth embodiment of the 
invention; 

Rg. 26 is a block diagram of a picture decoding 
apparatus which is a twentieth embodiment of the 
invention; 

Rg. 27(a) is a block diagram of a picture decoding 
apparatus which is a twenty-first embodiment of the 
invention; 

Rg. 27(b) is a diagram showing an example of signal 
processing of the twenty-first embodiment; 
Rg. 28 is a block diagram of a picture coding appa- 
ratus which is a twenty-second embodiment of the 
invention; 

Rg. 29 is a diagram showing pixel blocking in the 
twenty-second embodiment; 
Rg. 30 is a block diagram of a picture coding appa- 
ratus which is a twenty-third embodiment of the 
invention; 

Rg. 31 is a diagram showing largepixel blocking and 
small pixel blocking of the twenty-third embodiment; 
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Fig. 32 is a block diagram of a picture coding appa- 
ratus which is a twenty-fourth embodiment of the 
invention; 

Fig. 33 is a diagram showing pixel blocking in the 
twenty-fourth embodiment; 5 
Fig. 34 is a block diagram of a picture coding appa- 
ratus which is a-twenty-fifth embodiment of the . 
invention; 

Fig. 35 is a diagram showing single blocking in the 
twenty-fifth embodiment; 10 
Fig. 36 is a block diagram of a picture coding appa- 
ratus which is a twenty-sixth embodiment of the 
invention; and 

Fig. 37 is a diagram showing a process of storing a 
value for reducing high frequency components, into is 
a pixel which is not a pixel to be encoded, in the 
twenty-sixth embodiment. 

Detailed Description of the Invention 

20 

Referring now to Fig. 1, there is shown therein a 
block diagram of a picture coding apparatus which is a 
first embodiment of the invention. The reference numeral 
1 1 designates an input signal, 12 designates represent- 
ative picture selecting means, 13 designates a repre- - 25 
sentative picture signal, 14 designates a nonrepre- 
sentative picture signal, 15 designates representative 
picture coding means, 16 designates a representative 
picture coded signal, 1 7 designates coded signal gener- 
ating means, 18 designates a coded output signal, 21 30 
designates decoding means, 22 designates a represent- 
ative picture decoded signal. 23 designates reference 
signal selecting means, 24 designates a representative 
picture decoding reference signal, 25 designates motion 
parameter detecting means, 26 designates a motion 35 
parameter, 30 and 31 designate addition control signals, 

32 designates reference relationship adding means, and 

33 designates reference relationship adding information. 
The input signal 1 1 is a picture signal. 

The operation of the thus configured picture coding 40 
apparatus of the embodiment will be described. The rep- 
resentative picture selecting means 12 selectively out- 
puts from the input signal 1 1 which is a picture to be 
encoded, the representative picture signal 13 which will 
function as the representative picture of each scene, and 45 
the nonrepreserrtative picture signal 14 which is to be 
encoded as a predictive picture by motion compensa- 
tion. Examples of selecting a representative picture are 
listed below: 

50 

1. A picture which, in motion compensation, exhibits 
a minimum differential signal after motion compen- 
sation is selected. 

2. A picture which is easy to search in a search proc- 
ess is artificially selected. 55 

3. The first picture in a scene is selected. 

The scene may be a scene between scene changes 
in a picture, or a small scene which is obtained by parti- 
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tioning a scene between scene changes in accordance 
with the groups of motions of the object. The scene may 
be deemed as a scene which is united in contents of a 
picture. 

TTie representative picture ccKJjng means 15 
encodes the represnntntiw* pii'Ture signal 13, and out- 
puts the coded signal as the representative picture 
coded signal 16. Furthermore, the means determines 
the reference relationship for using the representative 
picture as a reference picture of predictive coding, and 
outputs the addition control signal 31 to the reference 
relationship adding means 32. The representative pic- 
ture may be encoded by. for example, a coding method 
in which orthogonal transformation of the discrete cosine 
transform (DOT) used in MPEG is performed and then 
transform coefficients are subjected to entropy coding. 
The invention is not restricted to the method. . 

The reference relationship adding means 32 gener- 
ates the reference relationship adding information 33 on 
the basis of the addition control signal 31 and the addition 
control signal 30 output from the reference signal select- 
ing means 23, and outputs the signal to the coded signal 
generating means 1 7. 

In the embodiment, the representative picture which 
represents each scene of a picture, and a predictive 
coded picture which refers the representative picture are 
encoded. Therefore, there is the case where the same 
representative picture is referred plural times in a plural- 
ity of scenes. The case shown in Fig. 11(b) will be 
described. The same representative picture A is referred 
in scenes 1 and 3, and hence representative pictures A 
and B are sufficient for the three scenes. In this case, 
therefore, the two representative pictures are encoded, 
and the reference relationships of additional information 
is "ABA". When the reference relationships are encoded 
as additional information in this way, a waste of duplica- 
tion of encoding the same representative picture is elim- 
inated. In addition to the reference relationship, 
significance in contents of the time series of represent- 
ative pictures is encoded. In decoding associated with a 
high speed search or high speed reproduction, therefore, 
only a representative picture of higher significance is 
allowed to be decoded only by referring additional infor- 
mation of significance. As an example of significance 
addition conditions, a condition that, when motion or 
deformation of the object between representative pic- 
tures is large in degree, significance is increased, and, 
when motion or deformation is small in degree, signifi- 
cance is reduced may be employed. 

The decoding means 21 decodes the representative 
picture coded signal 16, and outputs the representative 
picture decoded signal 22 to the reference signal select- 
ing means 23. The reference signal selecting means 23 
stores the representative picture decoded signal 22, 
selects a representative picture decoded signal corre- 
sponding to each nonrepreserrtative picture signal, and 
outputs the selected signal as the representative picture 
decoding reference signal 24 to the motion parameter 
detecting means 25. The reference signal selecting 
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means 23 outputs also a signal indicative of the scene 
the representative picture of which is used as the refer- 
ence picture, to the reference relationship adding means 
32 as the addition control signal 30. If the reference sig- 
nal selecting means 23 stores several previous repre- 5 
sentative pictures, it is possible to select an optimum 
representative pieture when motion parameters are to be 
detected, and the same representative picture can be 
referenced plural times over a plurality of scenes. 

The motion parameter detecting means 25 com- w 
pares the nonrepresentative picture signal 14 with the 
representative picture decoding reference signal 24, cal- 
culates motions between the two pictures to detect the 
motion parameter 26 for motion compensation coding, 
and outputs the detected parameter. In this case, when is 
the motion of the whole picture is written by global motion 
parameters such as translation, rotation, zooming, and 
reduction, the coding efficiency is improved. The predic- 
tive differential signal for the motion compensation may 
be encoded or the predictive differential signal coding 20 
may be omitted. The coded signal generating means 17 
combinedly outputs the motion parameter 26, the repre- 
sentative picture coded signal 1 6, and the reference rela- 
tionship adding information 33, as the coded output 
signal. 2 s 

As seen from the above description, in the embodi- 
ment, since the reference relationships of representative 
pictures are encoded as additional information, a waste 
of duplication of encoding the same representative pic- 
ture is eliminated. Therefore, the embodiment can real- 30 
ize a picture coding apparatus of excellent efficiency. 

Furthermore, in addition to the reference relation- 
ships, significance in contents of the time series of rep- 
resentative pictures is encoded. In decoding in a high 
speed search or high speed reproduction, therefore, only 35 
a representative picture of higher significance is allowed 
to be decoded only by referring additional information of 
significance. 

Referring to Fig. 2, there is shown therein a block 
diagram of a picture decoding apparatus which is a sec- 40 
ond embodiment of the invention. The reference numeral 
101 designates a coded input signal, 102 designates 
representative picture extracting means, 1 03 designates 
a coded representative picture signal. 104 designates 
representative picture decoding means, 1 05 designates 45 
a decoded representative picture signal, 1 06 designates 
a delay memory, 107 designates a decoded output sig- 
nal, 112 designates representative picture reference 
relationship extracting means. 1 13 designates reference 
relationship additional information, 114 designates so 
decoded signal output controlling means, and 115 des- 
ignates an output control signal. 

The operation of the thus configured picture decod- 
ing apparatus of the embodiment will be described. The 
coded input signal 101 is the coded output signal 18 ss 
which is encoded by the picture coding apparatus of the 
first embodiment, and consists of representative pictures 
which respectively represent scenes of a picture, motion 
parameters for motion compensation predictive coding 
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which refers the representative pictures, and additional 
information of reference relationships of the representa- 
tive pictures. The representative picture extracting 
means 102 extracts a representative picture from the 
coded input signal 101, anc^oujgutethe coded represent- 
ative picture "iggnl 1<n fiinnn the time intervals of the 
scenes are not constant, those of the representative pic- 
tures are not constant. The coded representative picture 
signal 103 is decoded by the representative picture 
decoding means 104, and sent as the decoded repre- 
sentative picture signal 105 to the delay memory 106. 

The representative picture reference relationship 
extracting means 112 extracts the reference relationship 
additional information 113 from the coded input signal 
101, and outputs the extracted information to the 
decoded signal output controlling means 114. On the 
basis of the reference relationship additional information 
1 13, the decoded signal output controlling means 1 14 
determines the order of outputting the representative pic- 
tures and output conditions, and outputs the output con- 
trol signal 115 to the delay memory 106. 

On the basis of the output control signal 115, the 
delay memory 106 outputs the decoded representative 
picture signal 105 as the decoded output signal 107. As 
the output conditions, for example, considered are the 
cases where, when the decoded representative picture 
signal 105 is input, the signal is output as it is based on 
the reference relationship, and where, in accordance 
with the target reproduction speed, the same decoded 
representative picture signal 105 is continuously output 
plural times. If the delay memory 106 stores several pre- 
vious representative pictures, when the same represent- 
ative picture is to be again output, the representative 
picture is allowed to be immediately output without con- 
ducting decoding and only by reading the decoded rep- 
resentative picture on the basis of the reference 
relationship additional information. 

The coded input signal 1 0 1 may be either of a coded 
input signal of a single layer and that for each layer based 
on a layered structure as far as the signal is encoded on 
the basis of the representative picture structure. 

Fig. 12 is a diagram illustrating an example of the 
operation of the embodiment The twelve pictures in the 
upper portion indicate the manner of reproduction in nor- 
mal decoding. In the picture decoding apparatus of the 
embodiment, since only representative pictures are 
extracted and decoded, decoding and reproduction are 
conducted on the three pictures in the lower portion. In 
this case, reproduction is done at a quadruple speed. 

As seen from the above description, according to the 
embodiment, the employment of the configuration in 
which the object of decoding is restricted to representa- 
tive pictures can realize high speed reproduction. 

Since the representative picture signal 13 is 
selected in consideration of scene changes of a picture, 
the signal corresponds to scene changes of a picture. 
Consequently, high speed reproduction or scene search 
of excellent efficiency which reflects the picture contents 
is enabled only by tracking representative pictures. 
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Referring to Fig. 3 ( there is shown therein a block 
diagram of a picture decoding apparatus which is a third 
embodiment of the invention. The reference numeral 101 
designates a coded input signal, 122 designates signifi- 
cance judging means, 123 designates a representative 5 
picture extraction control signal, 102 designates repre- 
sentative picture-extracting means, 103 designates a 
coded representative picture signal, 1 04 designates rep- 
resentative picture decoding means, 105 designates a 
decoded representative picture signal, 1 06 designates a w 
delay memory, and 107 designates a decoded output 
signal. The embodiment has a configuration in which the 
significance judging means 122 is provided in place of 
the representative picture reference relationship extract- 
ing means 1 1 2 and the decoded signal output controlling 15 
means 1 14 of the second embodiment. 

The operation of the thus conf igured picture decod- 
ing apparatus of the embodiment will be described. The 
coded input signal 101 is the coded output signal 18 
which is encoded by the picture coding apparatus of the 20 
first embodiment, and consists of representative pictures 
which respectively represent scenes of a picture, motion 
parameters for motion compensation predictive coding 
which refers the representative pictures, and additional 
information including reference relationships and signif- 25 
icance of the representative pictures. 

The significance judging means 122 extracts signif- 
icance of a coded representative picture from the coded 
input signal 101, and compares the extracted signifi- 
cance with a predetermined value. When the signifi- 30 
cance is higher, the significance judging means outputs 
the representative picture extraction control signal 123 
to the representative picture extracting means 102. On 
the basis of the representative picture extraction control 
signal 123, the representative picture extracting means 35 
1 02 extracts representative pictures from the coded input 
signal 1 01 , and outputs the coded representative picture 
signal 103. The subsequent operations are the same as 
those of the second embodiment, and hence their 
description is omitted. 40 

Fig. 13 is a diagram illustrating an example of the 
operation of the embodiment. The twelve pictures in the 
upper portion indicate the manner of reproduction in nor- 
mal decoding. In the embodiment, since only represent- 
ative pictures of higher significance are extracted and 45 
decoded, decoding and reproduction are conducted on 
the two pictures in the lower portion. In this case, repro- 
duction is done at a sextuple speed. 

As an example of conditions of determining signifi- 
cance in coding of the coded input signal 101, a tech- so 
nique in which significance is increased in accordance 
with a large change of scenes in the case where motion 
is largely changed may be employed. Alternatively, a 
technique in which significance is increased in accord- 
ance with a large change in contents of a scene in the ss 
case where the background or the object is changed may 
be employed. 

The coded input signal 1 0 1 may be either of a coded 
input signal of a single layer and that for each layer based 
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on a layered structure as tar as the signal is encoded on 
the basis of the representative picture structure. 

As seen from the above description, according to the 
embodiment, the employment of the configuration in 
which significance is conaderecLcan realize a picture 
decoding appgi^wy 'having functions of high speed 
reproduction and search which are further excellent in 
efficiency. 

Referring to Fig. 4, there is shown therein a block 
diagram of a picture decoding apparatus which is a fourth 
embodiment of the invention. The reference numeral 101 
designates a coded input signal, 102 designates repre- 
sentative picture extracting means, 103 designates a 
coded representative picture signal, 1 04 designates rep- 
resentative picture decoding means, 105 designates a 
decoded representative picture signal, 106 designates a 
delay memory, 107 designates a decoded signal, 132 
designates motion parameter extracting means, 133 
designates a motion parameter, 134 designates motion 
compensating means, 135 designates a. motion com- 
pensation decoded signal, 136 designates decoded sig- 
nal selecting means, and 137 designates a decoded 
output signal. The embodiment has a configuration in 
which the motion parameter extracting means 132, the 
motion compensating means 1 34, and the decoded sig- 
nal selecting means 1 36 are provided in place of the rep- 
resentative picture reference relationship extracting 
means 112 and the decoded signal output controlling 
means 1 14 of the second embodiment. 

The operation of the thus configured picture decod- 
ing apparatus of the embodiment will be described. The 
coded input signal 101 is the coded output signal 18 
which is encoded by the picture coding apparatus of the 
first embodiment, and consists of representative pictures 
which respectively represent scenes of a picture, motion 
parameters for motion compensation predictive coding 
which refers the representative pictures, and additional 
information including reference relationships of the rep- 
resentative pictures. 

The motion parameter extracting means 132 
extracts the motion parameter 133 which is required for 
decoding of a motion compensation predictive coded 
picture, from the coded input signal 101 , and outputs the 
extracted parameter to the motion compensating means 
134. On the basis of the motion parameter 133. the 
motion compensating means 134 conducts motion com- 
pensation with reference to the decoded signal 107 sent 
from the delay memory 1 06, and outputs the motion com- 
pensation decoded signal 135 to the decoded signal 
selecting means 136. The operations in the decoding of 
representative pictures are the same as those of the sec- 
ond embodiment, and hence their description is omitted. 

Under predetermined conditions, the decoded sig- 
nal selecting means 1 36 selects one of the decoded out- 
put signal 107 sent from the delay memory 106. and the 
motion compensation decoded signal 135 sent from the 
motion compensating means 134, and outputs the 
selected signal as the decoded output signal 137. For 
example, the conditions may be set so that in the case 
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where the motion compensation decoded signal 135 is 
output from the motion compensating means 134, the 
motion compensation decoded signal 135 is selected, 
and. in another case, the decoded output signal 107 of 
representative pictures is selected. 5 

The coded input signal 1 0 1 may be either of a coded 
input signatof a single layer and that for each layer based 
on a layered structure as far as the signal is encoded on 
the basis of the representative picture structure. 

As seen from the above description, in the embodi- w 
merit, a part of a predictive coded picture is decoded and 
then inserted between representative pictures, whereby 
a high speed search or high speed reproduction having 
continuity in addition to rapidness can be realized. 
Namely, the second and third embodiments have the is 
configuration in which only representative pictures are 
decoded while placing stress on rapidness of a search 
or reproduction. Since the time intervals of representa- 
tive pictures are not constant, however, the smoothness 
in the time direction is impaired with the result that unnat- 20 
uralness is produced in motions in reproduction. The 
present embodiment can improve this point. 

In the embodiment when a predictive coded signal 
is to be decoded, the representative picture signal to be 
reference and motion parameters are decoded. In other 25 
words, a picture coding apparatus suitable for a high 
speed search or high speed reproduction which can be 
conducted while checking the contents can be provided 
only by adding motion parameters. 

In the embodiment, when global motion parameters 30 
which can express translation, rotation, zooming, and 
reduction of the whole of a picture are used as motion 
parameters, it is possible to realize a high speed search 
or high speed reproduction of more excellent efficiency. 

Referring to Fig. 5. there is shown therein a block 35 
diagram of a picture decoding apparatus which is a fifth 
embodiment of the invention. The reference numeral 1 0 1 
designates a coded input signal, 142 designates predic- 
tive coded picture counting means, 143 designates a 
time interval control signal, 102 designates represerrta- 40 
five picture extracting means, 103 designates a coded 
representative picture signal, 104 designates represent- 
ative picture decoding means, 105 designates a 
decoded representative picture signal, 106 designates a 
delay memory, and 107 designates a decoded output 45 
signal. The embodiment has a configuration in which the 
predictive coded picture counting means 1 42 is provided 
in place of the representative picture reference relation- 
ship extracting means 1 12 and the decoded signal out- 
put controlling means 1 1 4 of the second embodiment so 

The operation of the thus configured picture decod- 
ing apparatus of the embodiment will be described. The 
coded input signal 101 is the coded output signal 18 
which is encoded by the picture coding apparatus of the 
first embodiment, and consists of representative pictures ss 
which respectively represent scenes of a picture, motion 
parameters for motion compensation predictive coding 
which refers the representative pictures, and additional 



information of reference relationships of the representa- 
tive pictures. 

The second and third embodiments have the config- 
uration in which only representative pictures are 
decoded while plaangj3fc£S£.on rapidness of a search 
or reprodbitliuiu Oinuj llieiime intervals of representa- 
tive pictures are not constant, however, the smoothness 
in the time direction is impaired with the result that unnat- 
uralness is produced in motions in reproduction. To com- 
ply with this, in the present embodiment, the time 
intervals of scenes, i.e., those of representative pictures 
are considered so that high speed reproduction in which 
stress is placed on the smoothness in the time direction 
is realized. 

The predictive coded picture counting means 142 
extracts predictive coded pictures which have undergone 
motion compensation coding while referring representa- 
tive pictures, from the coded input signal 101 , counts the 
number of the extracted pictures, and outputs the time 
interval control signal 143 to the delay memory 106. In 
accordance with the control of the output time intervals 
based on the time interval control signal 143, the delay 
memory 1 06 outputs the decoded representative picture 
signal 105 sent from the representative picture decoding 
means 104, as thedecoded output signal 1 07. As a result 
of the control of the output time intervals, the time interval 
of adjacent representative pictures constituting the 
decoded output signal 107 is shortened to that which is 
proportional to the counted number of the predictive 
coded pictures which exist between representative pic- 
ture signals included in the coded input signal 101. In 
summary, the control of the output time interval is set so 
that the time interval of adjacent representative pictures 
constituting the decoded output signal 107 is constant 
The operations in the decoding of representative 
pictures are the same as those of the second embodi- 
ment, and hence their description is omitted. 

Fig. 14 is a diagram illustrating an example of the 
operation of the embodiment. The twelve pictures in the 
upper portion indicate the manner of reproduction in nor- 
mal decoding. In the picture coding apparatus of the 
embodiment, representative pictures of each scene con- 
form to the time of each scene, i.e., the number of pre- 
dictive pictures. As illustrated, scene 1 consists of six 
pictures so that a representative picture is output three 
times, scene 2 consists of two pictures so that a repre- 
sentative picture is output one time, and scene 3 consists 
of four pictures so that a representative picture is output 
two times. In this way, high speed reproduction in which 
contents can be grasped in a relatively easy manner can 
be conducted at a double speed. In the same manner as 
the second and third embodiments, it is possible to elim- 
inate a mismatch in smoothness in the time direction. 

As seen from the above description, according to the 
embodiment, the number of the predictive coded pic- 
tures which exist between representative picture signals 
included in the coded input signal 101 is counted, and 
the time interval of representative pictures included in the 
decoded output signal 107 can be shortened to that 
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which is proportional to the number of the predictive 
coded pictures. This allows high speed reproduction to 
be realized while maintaining the original smoothness in 
the time direction of the picture. 

Referring to Fig. 6, there is shown therein a block s 
diagram of a picture coding apparatus which is a sixth 
embodiment of The invention. The reference numeral 
1011 designates a layer- 1 input signal, 1012 designates 
layer-1 coding means, 1013 designates a layer-1 coded 
signal, 1014 designates layer-1 coded signal generating w 
means, 1015 designates a layer-1 coded output signal, 
1021 designates a layer-2 input signal, 1022 designates 
layer-2 coding means, 1023 designates a Iayer-2 coded 
signal, 1024 designates layer-2 coded signal generating 
means, 1 025 designates a layer-2 coded output signal, is 

1002 designates layer significance determining means! 

1003 designates layer-1 significance additional informa- 
tion, and 1004 designates layer-2 significance additional 
information. 

The operation of the thus configured picture coding 20 
apparatus of the embodiment will be described. The 
embodiment will be described with the assumption that 
two layers are used. However, the number of layers in 
the picture coding apparatus of the invention is not 
restricted to two. The layer-1 input signal 101 1 and the 25 
layer-2 input signal 1021 are signals obtained as a result 
of the separation of a picture signal into two layers. 

The layer significance determining means 1002 
determines significance relating to the contents of the 
layers of the layer-1 input signal 101 1 and the layer-2 30 
input signal 1021, and outputs the layer-1 significance 
additional information 1003 to the layer-1 coded signal 
generating means 1014, and the layer-2 significance 
additional information 1004 to the layer-2 coded signal 
generating means 1 024. 35 

As examples of conditions of determining signifi- 
cance relating to the contents of the layers, following 
techniques may be employed. 



1. Significance is determined with using relation- 40 
ships of layers as an index. When stress is placed 

on a character or the like, for example, significance 
of the foreground layer, particularly of the layer of the 
character is increased. When stress is placed on 
scenery, significance of the background layer is 45 
increased. 

2. The area occupied by an object region in each 
layer is calculated, and significance is determined 
with using the area of a layer as an index. When the 
area is large, for example, significance is increased, so 
and, when the area is small, significance is 
decreased. 

3. The degree of motion or deformation of the object 
is calculated for each layer, and significance is deter- 
mined with using motion or deformation of a region 55 
of a layer as an index. When motion or deformation 

is large in degree, significance is increased, and, 
when motion or deformation is small in degree, sig- 
nificance is reduced. 



The layer-1 input signal 1011 is encoded by the 
layer-1 coding means 1012, and then output as the layer- 
1 coded signal 1013. The layer-2 input signal 1021 is 
encoded by the layer-2 coding means 1022, and then 
output as the layer-2_<^dedsignal 1023. In the coding 
process, t fag tarimiquo'o f-MPEG may be employed in 
which orthogonal transformation of the discrete cosine 
transform (DCT) is performed and then transform coef- 
ficients are subjected to entropy coding. However, the 
picture coding apparatus of the invention is not restricted 
to this method. 

On the basis of the layer-1 significance additional 
information 1003, the layer-1 coded signal generating 
means 1014 generates the layer-1 coded output signal 
1015 from the layer-1 coded signal 1013, and outputs 
the generated signal. On the basis of the layer-2 signifi- 
cance additional information 1004, the layer-2 coded sig- 
nal generating means 1024 generates the layer-2 coded 
output signal 1025 from the layer-2 coded signal 1023; 
and outputs the generated signal. 

As described above, a picture is first separated into 
layers such as a background, and a foreground, and 
each of the separated layers is encoded together with 
additional information indicative of significance of the 
layer. According to the embodiment, in decoding of the 
coded signals, significance of the additional information 
is referred. Then, a layer of higher significance is sub- 
jected to decoding which is detailed in contents, and that 
of lower significance is subjected to simplified decoding 
or refrained from being subjected to decoding, thereby 
realizing a high speed search or high speed reproduction 
in which waste is eliminated and which is excellent in effi- 
ciency. 

Referring to Fig. 7, there is shown therein a block 
diagram of a picture decoding apparatus which is a sev- 
enth embodiment of the invention. The reference 
numeral 201 designates layer significance judging 
means, 211 designates a layer-1 coded input signal, 212 
designates layer-1 decoding means, 213 designates a 
layer-1 decoded signal, 214 designates a layer-1 decod- 
ing control signal, 221 designates a layer-2 coded input 
signal, 222 designates layer-2 decoding means, 223 
designates a layer-2 decoded signal, 224 designates a 
layer-2 decoding control signal, 202 designates layer 
synthesizing means, and 203 designates a decoded out- 
put signal. 

The operation of the thus configured picture decod- 
ing apparatus of the embodiment will be described. The 
embodiment will be described with the assumption that 
two layers are used. However, the number of layers in 
the picture coding apparatus of the invention is not 
restricted to two. The layer-1 coded input signal 21 1 and 
the layer-2 coded input signal 221 are the layer-1 input 
signal 101 1 and the layer-2 input signal 1021 which are 
encoded by the picture coding apparatus of the sixth 
embodiment, respectively. The signals have been 
encoded with being added with significance of the 
respective layer. 



10 



EP0 711 078 A2 



20 



The layer significance judging means 201 compares 
significance of the layer-1 coded input signal 211 with 
that of layer-2 coded input signal 221 , and, on the basis 
of predetermined conditions, outputs the layer-1 decod- 
ing control signal 214tothe layer-1 decoding means 212, s 
and the layer-2 decoding control signal 224 to the layer- 
2 decoding means 222. The method of controlling the 
decoding in layer-1 is different from that in layer-2. 

On the basis of the layer-1 decoding control signal 
214, the layer-1 decoding means 212 decodes the layer- w 
1 coded input signal 211, and outputs the layer-1 
decoded signal 2 1 3 to the layer synthesizing means 202. 
On the basis of the layer-1 decoding control signal 224, 
the layer-2 decoding means 222 decodes the layer-2 
coded input signal 221 , and outputs the layer-2 decoded is 
signal 223 to the layer synthesizing means 202. As the 
decoding method, a method similar to the methods 
employed in the second to fifth embodiments may be 
employed. 

When the decoding method of the fourth embodi- 20 
merit is employed, for example, a picture decoding appa- 
ratus that can reproduce smooth motion from which 
picture contents can easily be grasped is realized by 
increasing the frequency of using motion compensation 
decoding in a layer of higher significance. With respect 25 
to a layer of lower significance, processing is restricted 
only to updation of a representative picture and stress is 
placed on rapidness, whereby a picture decoding appa- 
ratus that can simplify processing is realized. 

The layer synthesizing means 202 synthesizes the 30 
layer-1 decoded signal 213 with the layer-2 decoded sig- 
nal 223, and outputs the synthesized signal as the 
decoded output signal 203. 

As seen from the above description, according to the 
embodiment, significance of layers is compared on the 35 
basis of a coded signal of each layer which is an input 
signal, a layer of higher significance is subjected to 
detailed decoding, and that of lower significance is sub- 
jected to simplified decoding or refrained from being sub- 
jected to decoding, thereby realizing a high speed search 40 
or reproduction of excellent efficiency in which waste can 
be eliminated without impairing significance of contents 
of a picture. 

Referring to Fig. 8, there is shown therein a block 
diagram of a picture decoding apparatus which is an 45 
eighth embodiment of the invention. The reference 
numeral 311 designates a layer-1 coded input signal, 
312 designates layer-1 decoding means, 31 3 designates 
a decoding state signal. 301 designates predetermined- 
number judging means, 314 designates a layer-1 so 
decoded signal, 315 designates an output control signal, 
316 designates a layer-1 delay memory, 317designates 
a layeM decoded output signal, 321 designates a layer- 
2 coded signal, 322 designates layer-2 decoding means, 
323 designates a decoding state signal , 324 designates 55 
a layer-2 decoded signal, 325 designates an output con- 
trol signal, 326 designates a layer-2 delay memory, 327 
designates a layer-2 decoded output signal, 331 desig- 
nates a layer-3 coded signal, 332 designates layer-3 



decoding means. 333 designates a decoding state sig- 
nal, 334 designates a layer-3 decoded signal, 335 des- 
ignates an output control signal, 336 designates a layer- 
3 delay memory, 337 designates a layer-3 decoded out- 
put signal, 308 designa tes layer synthesizing means. 
ancLjjQg dr^ignntos^a decoded output signal. ~ 

The operation of the thus configured picture decod- 
ing apparatus of the embodiment will be described. The 
embodiment will be described with the assumption that 
three layers are used. However, the number of layers in 
the picture coding apparatus of the invention is not 
restricted to three. 

The layer-1 coded input signal 311, the layer-2 
coded input signal 321 , and the layer-3 coded input sig- 
nal 331 are coded signals obtained by separating a pic- 
ture into layers, and encoding each of signals of the 
separated layers. In the coding process, the technique 
of MPEG may be employed in which orthogonal trans- 
formation of the discrete cosine transform (DCT) is per- 
formed and then transform coefficients are subjected to 
entropy coding. The picture coding apparatus of the 
invention is not restricted to this method. The layer-1 
coded input signal 311, the layer-2 coded input signal 
321, and the layer-3 coded input signal 331 are coded 
signals each of which has a representative picture struc- 
ture in the time direction. 

The layer-1 decoding means 3 1 2 decodes the layer- 

1 coded input signal 31 1, outputs the decoded signal to 
the layer-1 delay memory 316 as the layer-1 decoded 
signal 314, and outputs the decoding state signal 313 to 
the predetermined-number judging means 301. On the 
basis of the output control signal 315 sent from the pre- 
determined-number judging means 301, the layer-1 
delay memory 316 outputs the layer-1 decoded signal 
314 to the layer synthesizing means 308 as the layer-1 
decoded output signal 31 7. 

The layer-2 decoding means 322 decodes the layer- 

2 coded input signal 32 1 and outputs the decoded signal 
to the layer-2 delay memory 326 as the layer-2 decoded 
signal 324, and outputs the decoding state signal 323 to 
the predetermined-number judging means 301. On the 
basis of the output control signal 325 sent from the pre- 
determined-number judging means 301, the layer-2 
delay memory 326 outputs the layer-2 decoded signal 
324 to the layer synthesizing means 308 as the layer-2 
decoded output signal 327. 

The layer-3 decoding means 332 decodes the iayer- 

3 coded input signal 321 and outputs the decoded signal 
to the layer-3 delay memory 336 as the layer-3 decoded 
signal 334, and outputs the decoding state signal 333 to 
the predetermined number judging means 301. On the 
basis of the output control signal 335 sent from the pre- 
determined number judging means 301, the layer-3 
delay memory 336 outputs the layer-3 decoded signal 
334 to the layer synthesizing means 308 as the layer-3 
decoded output signal 337. 

In coded signals having a representative picture 
structure, coding positions of representative picture in 
time series in layers are different from each other 
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depending on the layers. In a high speed search or high 
speed reproduction, therefore, the output updation posi- 
tion of a picture must be considered for each layer in a 
coding process. In a high speed search or high speed 
reproduction, furthermore, it is not required to update all 
layers, and the updation may be simplified or omitted as 
tetas contents can be grasped. When the apparatus is 
configured so that, only when layers the number of which 
is larger than a predetermined one are subjected to 
decoding, the output is updated, therefore, it is possible 
to execute a high speed search a high speed reproduc- 
tion in which waste is eliminated. 

On the basis of the decoding state signals 313, 323, 
and 333 respectively sent from the layer- 1 decoding 
means 312, the layer-2 decoding means 322, and the 
layer-3 decoding means 332, when layers the number of 
which is larger than the predetermined one are newly 
decoded, the predetermined number judging means 301 
outputs the output control signals 315, 325, and 335 to 
the delay memories 316, 326, and 336. 

As the decoding method conducted by the layer-1 
decoding means 312, the layer-2 decoding means 322, 
and the layer-3 decoding means 332, the methods 
employed in the second to fifth embodiments may be 
employed. 

Fig. 15 is a diagram illustrating an example of output 
updation between layers. Each of the downward arrows 
which are at the high speed reproduction update posi- 
tions indicates an output update position of a high speed 
search, and each of the upward arrows which are at the 
very high speed reproduction update positions indicates 
an output update position according to a very high speed 
search. In this example, the update conditions are "When 
a layer is decoded two times, all layers are updated and 
then output. Even when a plurality of layers are updated 
at the same time, it is regarded that the updation process 
is conducted one time." As seen also from the figure, the 
updation in the high speed search is conducted eleven 
times, but that in the very high speed search is conducted 
five times so that the processing is simplified. Since the 
number of ©inputting operations is reduced, it is possible 
to realize a high speed search or high speed reproduc- 
tion of a higher speed. 

As seen from the above description, according to the 
embodiment, when decoding of a representative picture 
signal is newly conducted in layers the number of which 
is greater than a predetermined one, the output of the 
representative picture is updated in all layers. Even when 
coding positions of representative pictures in time series 
in layers are different from each other, therefore, it is pos- 
sible to coincide output positions with each other. 

When the number of layers is less than the prede- 
termined number, the output of a representative picture 
is not updated. Consequently, processing is sirrplif ied so 
that a high speed search or high speed reproduction in 
which waste is eliminated is realized. 

Referring to Fig. 9, there is shown therein a block 
diagram of a picture decoding apparatus which is a ninth 
embodiment of the invention. The reference numeral 21 1 
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designates a layer-1 coded input signal, 212 designates 
layer-1 decoding means, 213 designates a layer-1 
decoded signal, 221 designates a layer-2 coded input 
signal, 222 designates layer-2 decoding means, 223 
designates a layer-2 decoded signal. 231 designates 
jaypr gpi^nft m M n C nnH 232 designates a decoded 
"oTrtput signal. 

The operation of the thus configured picture decod- 
ing apparatus of the embodiment will be described. The 
embodiment will be described with the assumption that 
two layers are used. However, the number of layers in 
the picture coding apparatus of the invention is not 
restricted to two. 

The layer-1 coded input signal 21 1 and the layer-2 
coded input signal 221 are signals which are obtained 
by separating a picture into layers (for example, into a 
foreground and a background), and encoding each of 
signals of the separated layers. In the coding process, 
the technique of MPEG may be employed in which 
orthogonal transformation of the discrete cosine trans- 
form (DCT) is performed and then transform coefficients 
are subjected to entropy coding. However, the picture 
coding apparatus of the invention is not restricted to this 
method. The layer-1 coded input signal 211 and the 
layer-2 coded input signal 221 are coded signals each of 
which has a representative picture structure in the time 
direction. 

The layer-1 decoding means 21 2 decodes the layer- 
1 coded input signal 21 1 , and outputs the decoded signal 
to the layer selecting means 231 as the layer-1 decoded 
signal. The layer-2 decoding means 222 decodes the 
layer-2 coded input signal 221 , and outputs the decoded 
signal to the layer selecting means 231 as the layer-2 
decoded signal. 

Under predetermined conditions, the layer selecting 
means 231 selects one of the layer-1 decoded signal 213 
and the layer-2 decoded signal 223, and outputs the 
selected signal as the decoded output signal 232. s 

The layer-1 decoding means 212 and the layer-2 
decoding means 222 are decoding means which use dif- 
ferent decoding methods. lneachoftheiayer-1 decoding 
means 212 and the layer-2 decoding means 222, a 
decoding method in conformance with the methods 
employed in the second to fifth embodiments may be 
employed. For example, it is assumed that the decoding 
method of the second embodiment in which only a rep- 
resentative picture is decoded is employed in the layer- 
1 decoding means 212, and that of the fourth embodi- 
ment in which a representative picture and a part of 
motion parameters are used is employed in the layer-2 
decoding means 222. In this case, when the layer select- 
ing means 231 is caused to select the layer-1 decoded 
signal 213 sent from the layer-1 decoding means 212, 
th e process can rapidly be jumped to an approximate pic- 
ture search position. When the layer selecting means 
231 is caused to select the layer-1 decoded signal 223 
sent from the layer-2 decoding means 222, high speed 
reproduction can be conducted while checking the con- 
tents. According to the picture decoding apparatus, since 
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reproduction is conducted while switching layers as 
described above, decoding of excellent efficiency which 
complies with the object of the high speed search or high 
speed reproduction can be realized. 

As seen from the abovedescription, according to the 



As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 



embodiment, decoding conforming to the object of t hr h '°"'H rr far.as it includes information of a transparent 



high speed or the high speed reproduction can be exe- 
cuted by selecting layers. 

Referring now to Fig. 16(a), there is shown therein 
a block diagram relating to a picture coding apparatus 
which is a tenth embodiment of the invention, and Fig. 
16(b) is a diagram showing binarization of binarizing 
means. Binarizing means 2002 which receives a mufti- 
value signal 2001 and outputs a binary signal 2003 is 
connected to binary coding means 2004 which receives 
the binary signal 2003 and outputs a coded signal 2005. 

Next, the operation of the embodiment will be 
described. 

The multivalue signal 2001 is a signal indicative of 
transparency of pixel values obtained from a picture sig- 
nal. The transparency has a distribution in which the ratio 
of intermediate level values is small or most elements 
are 0% or 100%. (Transparency of 0% indicates a state 
where an opaque article exists and the background can- 
not be seen, and transparency of 1 00% indicates a state 
where there is no article and the background can be seen 
as it is. An intermediate level value appears in the case 
where a translucent article made of glass or the like 
exists, or in a boundary between articles.) When inter- 
mediate level values of transparency of the multivalue 
signal 2001 are negligible, the multivalue signal 2001 is 
input to the binarizing means 2002 and then compared 
with the threshold of the binarizing means 2002 to be 
binarized. The binarizing means 2002 outputs the binary 
signal 2003. Specifically, the multivalue signal 2001 is 
binarized in such a manner that, when transparency of 
the multivalue signal is 100%, the value is set to be 0, 
and, when transparency is smaller than 100%, the value 
is set to be 1 . When the binary signal 2003 is input to the 
binary coding means 2004, the signal is subjected to 
binary coding in accordance with MR coding or the like. 
The binary coding means outputs a coded signal 2005. 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In 
the first coding, coding is conducted depending on 
whether transparency is 100% or has another value. In 
the second coding, when transparency has a small inter- 
mediate level value, it is regarded that the intermediate 
level value is negligible, and its coding is omitted. 

The binary coding in the binary coding means 2004 
is conducted in accordance with MR coding. The manner 
of the binary coding is not restricted to this. The binary 
coding may be conducted in accordance with chain cod- 
ing or block pattern coding. In short, any binary coding 
apparatus which can efficiently encode a binary may be 
used. 
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state of a pixel value. 

Referring to Fig. 17, there is shown therein a block 
diagram of a picture coding apparatus which is an elev- 
enth embodiment of the invention. Binarizing means 
2002 which receives a multivalue signal 2001 and out- 
puts a binary signal 2003 is connected to chaining 
means 2104 which receives the binary signal 2003 and 
outputs a chained data string 2105, and also to blocking 
means 2108 which receives the binary signal 2003 and 
outputs a block pattern 2109. The chaining means 2104 
is connected to chain coding means 21 06 which receives 
the chained data string 2105 and outputs a chain coded 
signal 2107. The blocking means 2108 is connected to 
block pattern collating means 2110 which receives the 
block pattern 2109 and outputs a block pattern number 
2111. The block pattern collating means 2110 is con- 
nected to block pattern coding means 2112 which 
receives the block pattern number 21 1 1 and outputs a 
block pattern coded signal 2113. The chain coding 
means 2106 and the block pattern coding means 21 12 
are connected to coded signal selecting means 2114 
which receives the chain coded signal 2107 and the 
block pattern coded signal 2113 and outputs a coded sig- 
nal 2005. 

Next, the operation of the embodiment will be 
described. 

The multivalue signal 2001 is a signal indicative of 
transparency of pixel values obtained from a picture sig- 
nal. The transparency has a distribution in which the ratio 
of intermediate level values is small or most elements 
are 0% or 100%. When intermediate level values of 
transparency of the multivalue signal 2001 are negligible, 
the multivalue signal 2001 is input to the binarizing 
means 2002 and then compared with the threshold of 
the binarizing means 2002 to be binarized. The binariz- 
ing means 2002 outputs the binary signal 2003. Specif- 
ically, the multivalue signal 2001 is binarized in such a 
manner that when transparency of the multivalue signal 
is 1 00%, the value is set to be 0, and. when transparency 
is smaller than 100%, the value is set to be 1 . When the 
binary signal 2003 is input to the chaining means 2104, 
the signal is classified into three cases: the case where 
a boundary pixel is on the right side of the boundary, that 
where a boundary pixel is on the left side of the boundary, 
and that where a boundary pixel is in front of the bound- 
ary, and the chained data string 2 1 05 conf igured into one 
data string is output When the chained data 2105 is 
input to the chain coding means 2 1 06, the data is binary- 
coded in accordance with entropy coding, and the chain 
coded signal 2107 is output. When the binary signal 
2003 is input to the blocking means 2108, the signal is 
divided into blocks and the blocking means then outputs 
the block pattern 2109. When the block pattern 2109 is 
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input to the block pattern collating means 2110. the block 
pattern is difference-compared in the unit of a block with 
a predetermined block pattern, and the block pattern 
number 2 1 11 at which the smallest difference is obtained 
is output. When the block pattern number 21 11 is input 



of intermediate level values is small or most elements 
are 0% or 100%. When the multivalue signal 2001 is 
input to the frequency distribution calculating means 
2202 t the frequency distribution of transparency is cal- 
cul atedfr om the multivalue signal 2001 to obtain the dis- 



to the Diock pattern coding means 21 12, binary co^oa^^0butw ratio of intermediate level values of transpar- 



is conducted in accordance with entropy coding, andlhe 
block pattern coded signal 2113 is output. When the 
chain coded signal 21 07 and the block pattern coded sig- 
nal 21 13 are input to the coded signal selecting means 
21 14. the coded signal which is smaller in code amount 
is selected, and the coded signal 2005 is output. 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In 
the first coding wherein coding is conducted depending 
on whether transparency is 100% or has another value, 
among coded signals which are encoded by the two 
kinds of binary coding means arranged in parallel, a 
coded signal which is smaller in code amount is output, 
whereby the coding efficiency can be improved. In the 
second coding corresponding to an intermediate level 
value of transparency, when transparency has a small 
intermediate level value, it is regarded that the interme- 
diate level value is negligible, and its coding can be omit- 
ted. 

As the binary coding means, chain coding and block 
pattern coding are used. The means is not restricted to 
them, and may be realized by MH coding and MMR cod- 
ing. In short, any binary coding apparatus may be used 
as far as it can efficiently encode a binary. 

As the means for determining whether a pixel is to 
be encoded or not. transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 18, there is shown therein a block 
diagram of a picture coding apparatus which is a twelfth 
embodiment of the invention. Frequency distribution cal- 
culating means 2202 which receives a murtivaiue signal 
2001 and outputs a control signal 2204 is connected to 
coding selecting means 2203 which receives the mufti- 
value signal 2001 and outputs multivalue signals 2205 
and 2208. The coding selecting means 2203 is con- 
nected to multivalue coding means 2206 which receives 
the multivalue signal 2205 and outputs a coded signal 
2207, and also to binarizing means 2002 which receives 
the multivalue signal 2208 and outputs a binary signal 
2003. The binarizing means 2002 is connected to binary 
coding means 2004 which receives the binary signal 
2003 and outputs a coded signal 2005. 

Next, the operation of the embodiment will be 
described. 

The multivalue signal 2001 is a signal indicative of 
transparency of pixel values obtained from a picture sig- 
nal. The transparency has a distribution in which the ratio 
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ency. The distribution ratio of intermediate level values 
of transparency is compared with a predetermined 
threshold, and the control signal 2204 is output depend- 
ing on the comparison result. When the control signal 

2204 is input to the coding selecting means 2203, the 
output destination of the multivalue signal 2001 which is 
separately input is switched in accordance with the con- 
trol signal 2204. Specifically, when the distribution ratio 
of intermediate level values of transparency is larger than 
the threshold, the multivalue signal 2001 & output to the 
multivalue signal 2205, and, when the distribution ratio 
of intermediate level values of transparency is smaller 
than the threshold, the multivalue signal 2001 is output 
to the multivalue signal 2208. When the multivalue signal 

2205 is input to the multivalue coding means 2206, the 
signal is multivalue-coded by a coding process in which 
orthogonal transformation is combined with entropy cod- 
ing, and the multivalue coding means 2206 outputs the 
coded signal 2207. When the multivalue signal 2208 is 
input to the binarizing means 2002, the signal is bina- 
rized in accordance with its threshold, and the binarizing 
means 2002 outputs the binary signal 2003. Specif ically, 
the multivalue signal 2208 is binarized in such a manner 
that, when transparency of the multivalue signal is 1 00%, 
the value is set to be 0, and, when transparency is 
smaller than 100%, the value is set to be 1. When the 
binary signal 2003 is input to the binary coding means 
2004, the signal is subjected to binary coding in accord- 
ance with MR coding or the like. The binary coding 
means 2004 outputs the coded signal 2005. 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In 
the first coding, coding is conducted depending on 
whether transparency is 100% or has another value. In 
the second coding, when it is judged from the distribution 
ratio of intermediate level values of transparency that 
coding of intermediate level values is required, coding of 
intermediate level values is conducted by a predeter- 
mined multivalue coding apparatus. 

The coding apparatus in the multivalue coding 
means 2206 conducts coding in which orthogonal trans- 
formation is combined with entropy coding. The way of 
coding is not restricted to this. Alternatively, coding may 
be conducted in accordance with Wavelet transform cod- 
ing. In short any multivalue coding apparatus may be 
used as far as it can efficiently encode a multivalue. 

The coding in the binary coding means 2004 is con- 
ducted in accordance with MR coding. The manner of 
the coding is not restricted to this. The coding may be 
conducted in accordance with chain coding or block pat- 
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tern coding. In short, any binary coding apparatus which 
can efficiently encode a binary may be used. 

As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- s_ 
ness on which information of transparency of pbtnl'mlttnir 
is superposed may. be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 1 9(a), there is shown therein a block 10 
diagram of a picture coding apparatus which is a thir- 
teenth embodiment of the invention, and Fig. 19(b) is a 
diagram showing an example of a gradient in gradient 
calculating means. Binarizing means 2002 which 
receives a multivalue signal 2001 and outputs a binary is 
signal 2003 is connected to binary coding means 2004 
which receives the binary signal 2003 and outputs a 
coded signal 2005. Gradient calculating means 2006 
which receives the multivalue signal 2001 and outputs a 
gradient value 2007 is connected in parallel with the bina- 20 
rizing means. 

Next, the operation of the embodiment will be 
described. 

The multivalue signal 2001 is a signal indicative of 
transparency of pixel values obtained from a picture sig- 25 
nal. The transparency has a distribution in which the ratio 
of intermediate level values is small or most elements 
are 0% or 100%. When the multivalue signal 2001 is 
input to the binarizing means 2002, the multivalue signal 
2001 is compared with the threshold value of the bina- 30 
rizing means 2002 to be binarized, and the binarizing 
means 2002 outputs the binary signal 2003. Specifically, 
the multivalue signal 2001 is binarized in such a manner 
that, when transparency of the multivalue signal is 1 00%, 
the value is set to be 0, and, when transparency is 35 
smaller than 100%, the value is set to be 1. When the 
binary signal 2003 is input to the binary coding means 
2004, the signal is encoded in accordance with MR cod- 
ing, and the coded signal 2005 is output. When the mul- 
tivalue signal 2001 is input to the gradient calculating 40 
means 2006, the gradient of the intermediate value por- 
tion which is between the maximum value and the zero 
value is calculated from transparency of pixel values 
obtained from the multivalue signal 2001 , and the gradi- 
ent value 2007 which is a typical value of the gradient is 45 
output. 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In so 
the first coding, coding is conducted depending on 
whether transparency is 100% or has another value. In 
the second coding, coding is conducted by approximat- 
ing coding of intermediate level values of transparency. 

In the second coding, when intermediate level val- ss 
ues in the vicinity of a boundary of an article have a larger 
ratio of distribution of a transparency gradient of 0% to 
100%, intermediate level values may be approximated 



by a constant gradient, thereby reducing the code 
amount the intermediate level values. 

The threshold of the binarizing means 2002 is set to 
be 100% of transparency of pixel values. Alternatively, 
the threshold may be set to be a predetermined value 
-which is not 1 00%. In the alternative, the gradient calcu- 
lating means 2006 calculates the gradient of the thresh- 
old, and the gradient value 2007 which is a typical value 
of the gradient is output. 

The coding in the binary coding means 2004 is con- 
ducted in accordance with MR coding. The manner of 
the coding is not restricted to this. The coding may be 
conducted in accordance with chain coding or block pat- 
tern coding. In short, any binary coding apparatus which 
can efficiently encode a binary may be used. 

As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 20(a) , there is shown therein a block 
diagram of a picture coding apparatus which is a four- 
teenth embodiment of the invention, and Fig. 20(b) is a 
diagram showing a difference in difference calculating 
means. Binarizing means 2002 which receives a multi- 
value signal 2001 and outputs a binary signal 2003 is 
connected to binary coding means 2004 which receives 
the binary signal 2003 and outputs a coded signal 2005, 
and also to multivaluing means 2304 which receives the 
binary signal 2003 and outputs an inverted binary signal 
2305. The multivaluing means 2304 is connected to dif- 
ference calculating means 2306 which receives the mul- 
tivalue signal 2001 and the inverted binary signal 2305 
and outputs a difference signal 2307. The difference cal- 
culating means 2306 is connected to multivalue coding 
means 2308 which receives the difference signal 2307 
and outputs a coded signal 2309. 

Next, the operation of the embodiment will be 
described. 

The multivalue signal 2001 is a signal indicative of 
transparency of pixel values obtained from a picture sig- 
nal. The transparency has a distribution in which the ratio 
of intermediate level values is small or most elements 
are 0% or 100%. When the multivalue signal 2001 is 
input to the binarizing means 2002, the signal is com- 
pared with a predetermined threshold of the binarizing 
means 2002 to be binarized. Specifically, binarizing is 
conducted in such a manner that, when the multivalue 
signal 2001 is equal to the threshold, the value is set to 
be 0, and, when the signal is smaller than the threshold, 
the value is set to be 1 , and then the binary signal 2003 
is output. When the binary signal 2003 is input to the 
binary coding means 2004, the signal is subjected to 
binary coding in accordance with MR coding or the like. 
When the binary signal 2003 is input to the multivaluing 
means 2304, the signal is muftivalued and the inverted 
binary signal 2305 is output. When the inverted binary 
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signal 2305 and the multivalue signal 2001 are input to 
the difference calculating means 2306, the difference 
between the signals is output as the difference signal 
2307. When the difference signal 2307 is input to the 
multivalue coding means 2308. the signal is multivalue- 
coded by encoding in which orthogonal transformation 
is combined with entropy coding, and the coded signal 
2309 is output. 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In 
the first coding, coding is conducted depending on 
whether transparency is 100% or has another value. In 
the second coding, coding is conducted on the difference 
signal between the binary signal depending on whether 
transparency is 1 00% or has another value, and the mul- 
tivalue signal indicative of intermediate level values of 
transparency. 

The coding in the binary coding means 2004 is con- 
ducted in accordance with MR coding. The manner of 
the coding is not restricted to this. The coding may be 
conducted in accordance with chain coding or block pat- 
tern coding. In short, any binary coding apparatus which 
can efficiently encode a binary may be used. 

The multivalue coding means 2308 conducts coding 
in which orthogonal transformation is combined with 
entropy coding. The way of coding is not restricted to this. 
Alternatively, coding may be conducted in accordance 
with Wavelet transform coding. In short, any multivalue 
coding means may be used as far as it can efficiently 
encode a multivalue 

The difference calculating means 2306 calculates a 
difference with using the inverted binary signal 2305. 
Alternatively, a difference may be obtained with refer- 
ence to the threshold of the binarizing means 2002. 

As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 21 (a), thereis shown therein a block 
diagram of a picture coding apparatus which is a fifteenth 
embodiment of the invention, Fig. 21(b) is a diagram 
showing an example of a multivalue signal 2001, Fig. 
21 (c) is a diagram showing an example of a binary signal 
2003, and Fig. 21(d) is a diagram showing an example 
of a binary signal 2403. Binarizing means 2002 which 
receives the multivalue signal 2001 and outputs the 
binary signal 2003 is connected to binary coding means 
2004 which receives the binary signal 2003 and outputs 
a coded signal 2005, Frequency distribution calculating 
means 2406 which receives the multivalue signal 2001 
and outputs a threshold 2407 is connected to binarizing 
means 2402 which receives the multivalue signal 2001 
and the threshold 2407 and outputs the binary signal 
2403. The binarizing means 2402 is connected to binary 
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coding means 2404 which receives the binary signal 
2403 and outputs a coded signal 2405. 

Next, the operation of the embodiment will be 
described. 

~_ The multivalue signal 2001 is a signal indicative of 

• -transparency of pixel values obtained from a picture sig- 
nal. The transparency has a distribution in which the ratio 
of intermediate level values is small or most elements 
are 0% or 100%. When the multivalue signal 2001 is 
input to the binarizing means 2002, the signal is bina- 
rized in accordance with its threshold, and the binary sig- 
nal 2003 is output. Specifically, the multivalue signal 
2001 is binarized in such a manner that, when transpar- 
ency of the multivalue signal is 1 00%, the value is set to 
be 0, and, when transparency is smaller than 100%, the 
value is set to be 1 . When the binary signal 2003 is input 
to the binary coding means 2004, the signal is coded in 
accordance with MR coding, and the coded signal 2005 
is output When the multivalue signal 2001 is input to the 
frequency distribution calculating means 2406, the fre- 
quency distribution of transparency of pixel values of the 
multivalue signal 2001 is calculated to obtain the distri- 
bution ratio of intermediate level values of transparency. 
The distribution ratio of intermediate level values of 
transparency is compared with a predetermined thresh- 
old, and the threshold 2407 (its value is k%) of the bina- 
rizing means 2402 is output depending on the 
comparison result. The binarizing means 2402 conducts 
binarization in accordance with the threshold 2407. Spe- 
cifically, the multivalue signal 2001 is binarized in such a 
manner that, when the signal is k%, the value is set to 
be 0, and, when the signal is larger than k%, the value 
is set to be 1 , and the binary signal 2403 is output. When 
the binary signal 2403 is input to the binary coding 
means 2404, the signal is subjected to coding in accord- 
ance with MR coding, and the coded signal 2405 is out- 
put. 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In 
the first coding, coding is conducted depending on 
whether transparency is 100% or has another value. In 
the second coding, coding is conducted on a binarized 
signal with using a value calculated from the distribution 
ratio of intermediate level values of transparency, as the 
threshold. 

The coding in the binary coding means 2004 and the 
binary coding means 2404 is conducted in accordance 
with MR coding. The manner of the coding is not 
restricted to this. The coding may be conducted in 
accordance with chain coding or block pattern coding. In 
short, any binary coding apparatus which can efficiently 
encode a binary may be used. 

As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel val ues 
is superposed may be used. In short, any means may 
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be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 22, there is shown therein a block 
diagram of a picture coding apparatus which is a six- 
teenth embodiment of the invention. Frequency distribu- s 
tion calculating means 2502 which rrrni^nnmult'iHfniiir . 
signal 2001 and outputs a reference value 2503 is con- 
nected to binarizing means 2002 which receives a mul- 
tivalue signal 2001 and the reference value 2503 and 
outputs a binary signal 2003. The binarizing means 2002 io 
is connected to binary coding means 2004 which 
receives the binary signal 2003 and outputs a coded sig- 
nal 2005, and also to multivaluing means 2504 which 
receives the binary signal 2003 and outputs an inverted 
binary signal 2505. The multivaluing means 2504 is con- is 
nected to difference calculating means 2506 which 
receives the multivalue signal 2001 and the inverted 
binary signal 2505 and outputs a difference signal 2507. 
The difference calculating means 2506 is connected to 
multivalue coding means 2508 which receives the differ- 20 
ence signal 2507 and outputs a coded signal 2509. 

Next, the operation of the embodiment will be 
described. 

The multivalue signal 2001 is a signal indicative of 
transparency of pixel values obtained from a picture sig- 25 
nal. The transparency has a distribution in which the ratio 
of intermediate level values is small or most elements 
are 0% or 100%. When the multivalue signal 2001 is 
input to the frequency distribution calculating means 
2502, the frequency distribution of transparency of pixel 30 
values of a picture signal is calculated. In accordance 
with the frequency distribution of transparency which is 
third in degree, the reference value 2503 is output. When 
the reference value 2503 is input to the binarizing means 
2002, the multivalue signal 2001 which is another input 35 
is binarized in accordance with the reference value 2503. 
Specifically, the multivalue signal 2001 is binarized in 
such a manner that, when the multivalue signal 2001 is 
equal to the reference value 2503, the value is set to be 
0, and, when the multivalue signal 2001 is smaller than 40 
the reference value 2503, the value is set to be 1 , and 
the binary signal 2003 is output. When the binary signal 
2003 is input to the binary coding means 2004, the signal 
is coded in accordance with MR coding, and the coded 
signal 2005 is output. When the binary signal 2003 is 45 
input to the multivaluing means 2504, the signal is mul- 
tivalued and the inverted binary signal 2505 is output. 
When the inverted binary signal 2505 and the multivalue 
signal 2001 are input to the difference calculating means 
2506, the difference between the signals is calculated, so 
and the difference signal 2507 is output. When the dif- 
ference signal 2507 is input to the muftivalue coding 
means 2508, the signal is multivalue-coded by encoding 
in which orthogonal transformation is combined with 
entropy coding, and the coded signal 2509 is output. 55 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In 
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the first coding in which coding is conducted depending 
on whether transparency is 100% or has another value, 
coding is conducted on a binary signal which is binarized 
in accordance with the threshold based on the frequency 
distribution of transparency which is third in degree. In 
.the second coding for an intermediate level value of 
transparency, coding is conducted on the difference 
between the binary signal and the multivalue signal indic- 
ative of an intermediate level value of transparency 

The coding in the binary coding means 2004 is con- 
ducted in accordance with MR coding. The manner of 
the coding is not restricted to this. The coding may be 
conducted in accordance with chain coding or block pat- 
tern coding. In short, any multivalue coding apparatus 
which can efficiently encode a binary may be used. 

In the multivalue coding means 2508, coding in 
which orthogonal transformation is combined with 
entropy coding is conducted. The way of coding is not 
restricted to this. Alternatively, coding maybe conducted 
in accordance with Wavelet transform coding. In short, 
any multivalue coding apparatus may be used as far as 
it can efficiently encode a multivalue. 

As the means for determining whether a pixel is to 
be encoded or not. transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 23, there is shown therein a block 
diagram of a picture coding apparatus which is a seven- 
teenth embodiment of the invention. Binarizing means 
2002 which receives a multivalue signal 2001 and out- 
puts a binary signal 2003 is connected to binary coding 
means 2004 which receives the binary signal 2003 and 
outputs a coded signal 2005, and also to region extract- 
ing means 2606 which receives the binary signal 2003 
and outputs a nontransmission signal 2607 and a non- 
transmission region 2608. The region extracting means 
2606 is connected to multivaluing means 2609 which 
receives the nontransmission signal 2607 and outputs 
an inverted binary pixel signal 2610. The multivaluing 
means 2609 is connected to difference calculating 
means 261 1 which receives the multivalue signal 2001 
and the inverted binary pixel signal 2610 and outputs a 
difference signal 261 2. The difference calculating means 
2611 is connected to multivaluing means 2613 which 
receives the difference signal 2612 and outputs a multi- 
value signal 2614. The multivaluing means 2613 is con- 
nected to intraregion multivalue coding means 2615 
which receives the muftivalue signal 2614 and outputs a 
coded signal 2616. 

Next, the operation of the embodiment will be 
described. 

The multivalue signal 2001 is a signal indicative of 
transparency of pixel values obtained from a picture sig- 
nal. The transparency has a distribution in which the ratio 
of intermediate level values is small or most elements 
are 0% or 100%. When the multivalue signal 2001 is 
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input to the binarizing means 2002, the signal is com- 
pared with the threshold of the binarizing means 2002 to 
be binarized, and the binarizing means 2002 outputs the 
binary signal 2003. Specifically, the multivalue signal 
2001 is binarized in such a manner that, when the signal * 
is 1 00%, the value is set to be 0, and, whgrtto&sigaiLSrf 
smaller than 100%, the value is set to be~1. When the 
binary signal 2003 is input to the binary coding means 
2004, the signal is subjected to binary coding in accord- 
ance with MR coding, and the binary coding means out- 
puts the coded signal 2005. When the binary signal 2003 
is input to the region extracting means 2606, a pixel 
region in which transparency is not 100% is extracted. 
The extracted region is output as the norrtransmission 
region 2608, and a pixel value signal of the transparency 
is output as the nontransmission signal 2607. When the 
nontransmission signal 2607 is input to the multivaluing 
means 2609. the signal is converted into a multivalue sig- 
nal and the inverted binary pixel signal 2610 is output. 
When the multivalue signal 2001 and the inverted binary 
pixel signal 2610 are input to the difference calculating 
means 261 1 . the difference between the signals is cal- 
culated, and the difference signal 2612 is output. When 
the difference signal 2612 is input to the multivaluing 
means 2613, the signal is multivalued by comparing it 
with the threshold of the multivaluing means 2613, and 
the multivaluing means 2633 outputs the multivalue sig- 
nal 2614. When the multivalue signal 2614 is inputtothe 
intraregion multivalue coding means 2615, the signal is 
muttivalue-coded by encoding in which orthogonal trans- 
formation is combined with entropy coding, and the 
coded signal 2616 is output. 

As seen from the above description, according to the 
embodiment, a multivalue signal coding apparatus in 
which transparency of pixel values obtained from a pic- 
ture signal is used as a multivalue signal is provided. In 
the first coding, coding is conducted depending on 
whether transparency is 100% or has another value. In 
the second coding, coding is conducted by extracting 
only a region in which transparency is not 1 00%, and cal- 
culating a difference between an intermediate-value por- 
tion of the region and a portion of transparency of 0%. 

Alternatively, the intraregion multivalue coding 
means 2615 may conduct the intraregion binary coding 
after binarization using a second threshold. 

The coding in the binary coding means 2004 is con- 
ducted in accordance with MR coding. The manner of 
the coding is not restricted to this. The coding may be 
conducted in accordance with chain coding or block pat- 
tern coding. In short, any multivalue coding apparatus 
which can efficiently encode a binary may be used. 

In the multivalue coding means 2615. coding in 
which orthogonal transformation is combined with 
entropy coding is conducted. The way of coding is not 
restricted to this. Alternatively, coding may be conducted 
in accordance with Wavelet transform coding. In short, 
any multivalue coding apparatus may be used as far as 
it can efficiently encode a multivalue. 
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As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 24, there is shown therein a block 
diagram of a picture decoding apparatus which is an 
eighteenth embodiment of the invention. Coded signal 
separating means 2722 which receives a coded signal 
2721 and outputs a binary coded signal 2723 and an 
additional information coded signal 2728 is connected to 
binary signal decoding means 2724 which receives the 
binary coded signal 2723 and outputs a binary pixel sig- 
nal 2725, and also to additional information selecting 
means 2729 which receives the additional information 
coded signal 2728 and outputs an additional information 
coded signal to be decoded 2730. The coded signal sep- 
arating means 2722 is connected to the binary signal 
decoding means 2724 which receives the binary coded 
signal 2723 and outputs the binary pixel signal 2725. The 
binary signal decoding means 2724 is connected to mul- 
tivaluing means 2726 which receives the binary pixel sig- 
nal 2725 and outputs an inverted binary pixel signal 
2727. The additional information selecting means 2729 
is connected to additional information decoding means 
2731 which receives the additional information coded 
signal to be decoded 2730 and outputs a multivalue pixel 
signal 2732. The multivaluing means 2726 and the addi- 
tional information decoding means 2731 are connected 
to multivalue signal synthesizing means 2733 which 
receives the inverted binary pixel signal 2727 and the 
multivalue pixel signal 2732 and outputs a multivalue sig- 
nal 2734. 

Next, the operation of the embodiment will be 
described. 

The coded signal 2721 is a coded signal in which a 
code obtained by encoding transparency in the case 
where pixel values obtained from a picture signal have 
transparency of 0% or 100% is integrated with a code 
obtained by encoding intermediate values of transpar- 
ency. When the coded signal 2721 is input to the coded 
signal separating means 2722, the signal is separated 
into the binary coded signal 2723 corresponding to trans- 
parency of 0% or 100% of pixel values obtained from a 
picture signal, and the additional information coded sig- 
nal 2728 corresponding to intermediate values of trans- 
parency. When the binary coded signal 2723 is input to 
the binary signal decoding means 2724. the signal is 
decoded to a binary signal, and the binary pixel signal 
2725 is output. When the binary pixel signal 2725 is input 
to the multivaluing means 2726, the binary pixel signal 
2725 which is a binary signal is converted into a multi- 
value signal and the inverted binary pixel signal 2727 is 
output. When the additional information coded signal 
2728 is input to the additional information selecting 
means 2729, the additional information coded signal to 
be decoded 2730 is output only in the case where the 
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additional information coded signal 2728 includes a code 
of intermediate values of transparency. When the addi- 
tional information coded signal to be decoded 2730 is 
input to the additional information decoding means 2731 , 
the signal is decoded and the multivalue pixel signal 
2732 is output. When the mnith/ajna ■f^t\r\\~?7y i 
and the inverted binary pixel signal 2727 are input to the 
multivalue signal synthesizing means 2733, the two sig- 
nals are synthesized with each other and the multivalue 
signal 2734 is output. 

As seen from the above description, according to the 
embodiment, an apparatus is provided in which, in the 
first decoding, a binary coded signal in the case where 
transparency is 100% or has another value is decoded, 
and, in the second decoding, a coded signal of an inter- 
mediate level value of transparency is decoded, and a 
multivalue signal of transparency is decoded by super- 
imposing the decoded signals with each other. 

Referring to Fig. 25, there is shown therein a block 
diagram of a picture decoding apparatus which is a nine- 
teenth embodiment of the invention. Coded signal sep- 
arating means 2702 which receives a coded signal 2701 
and outputs a binary coded signal 2703 and a gradient 
value 2708 is connected to binary signal decoding 
means 2704 which receives the binary coded signal 
2703 and outputs a binary signal 2705. and also to mul- 
tivalue signal decoding means 2709 which receives the 
gradient value 2708 and outputs a multivalue pixel value 
2710. The binary signal decoding means 2704 is con- 
nected to pixel value converting means 2706 which 
receives the binary signal 2705 and outputs a binary 
pixel signal 2707. The pixel value converting means 
2706 is connected to multivaluing means 271 1 which 
receives the binary pixel signal 2707 and outputs an 
inverted binary pixel signal 2712. The multivaluing 
means 271 1 and the multivalue signal decoding means 
2709 are connected to synthesizing means 2713 which 
receives the inverted binary pixel signal 271 2 and out- 
puts a multivalue signal 2714. 

Next, the operation of the embodiment will be 
described. 

The coded signal 2701 is a coded signal in which 
the coded signal 2005 and the gradient value 2007 
shown in Fig. 19 are integrated with each other. When 
the coded signal 2701 is input to the coded signal sepa- 
rating means 2702, the signal is separated into the 
binary coded signal 2703 and the gradient value 2708. 
When the binary coded signal 2703 is input to the binary 
signal decoding means 2704, the signal is decoded to a 
binary signal and the binary signal 2705 is output. When 
the binary signal 2705 is input to the pixel value convert- 
ing means 2706, transparency of 100% is substituted in 
the case of 0, a predetermined value is substituted in the 
case of 1, and the binary pixel signal 2707 is output. 
When the binary pixel signal 2707 is input to the multi- 
valuing means 271 1 , the signal is converted into a mul- 
tivalue signal and the inverted binary pixel signal 2712 
is output When the gradient value 2708 is input to the 
multivalue signal decoding means 2709, extrapolation 
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starting with 0 is conducted on the basis of the gradient 
value 2708, and the multivalue pixel value 271 0 is output. 
The inverted binary signal 2712 and the multivalue pixel 
value 2710 are synthesized with each other by the syn- 
thesizing means 2713, and then output as the multivalue 
signa!2714. 

As seen from the above description, according to the 
embodiment, a multivalue signal decoding apparatus 
which decodes a signal coded by the coding apparatus 
of Fig. 19 is provided. In the first decoding, a binary 
coded signal in the case where transparency of a pixel 
value obtained from a picture signal is 100% or has 
another value is decoded. In the second decoding, a sig- 
nal in which intermediate level values of transparency 
are approximated as gradient values is decoded. The 
decoded signals are superimposed with each other, 
whereby a multivalue signal of transparency can be 
decoded. 

When the threshold of the binarizing means 2002 of 
Fig. 19 is set to be a predetermined value other than 0, 
the pixel value converting means 2706 substitutes 100% 
in the case where the binary signal 2705 is 0, and a pre- 
determined maximum value in the case where the signal 
is 1. The multivalue signal decoding means 2709 con- 
ducts predetermined extrapolation on intermediate level 
values on the basis of the gradient value 2708. 

Referring to Fig. 26, there is shown therein a block 
diagram of a picture decoding apparatus which is a twen- 
tieth embodiment of the invention. Decoding means 
2802 which receives a binary coded signal 280 1 and out- 
puts a binary decoded signal 2803 is connected to mul- 
tivaluing means 2804 which receives the binary decoded 
signal 2803 and outputs an inverted binary signal 2805. 
The multivaluing means 2804, and decoding means 

2809 which receives a differential coded signal 2808 and 
outputs a differential decoded signal 2810 are connected 
to differential adding means 2806 which receives the 
inverted binary signal 2805 and the differential decoded 
signal 2810 and outputs a multivalue signal 2807. 

Next, the operation of the embodiment will be 
described. 

When the binary coded signal 2801 is input to the 
decoding means 2802, the signal is decoded to a binary 
signal, and the binary decoded signal 2803 is output. 
When the binary decoded signal 2803 is input to the mul- 
tivaluing means 2804, the signal is converted into a mul- 
tivalue signal, and the inverted binary signal 2805 is 
output. When the differential coded signal 2808 is input 
to the decoding means 2809, the signal is decoded to a 
multivalue signal, and the differential decoded signal 

281 0 is output. When the inverted binary signal 2805 and 
the differential decoded signal 2810 are input to the dif- 
ferential adding means 2806, the two signals are added 
to each other and the multivalue signal 2807 is output. 

As seen from the above description, according to the 
embodiment, a multivalve signal decoding apparatus 
which decodes a signal coded by the coding apparatus 
of Fig. 20 is provided. In the first decoding, a binary 
coded signal in the case where transparency of a pixel 
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value obtained from a picture signal is 100% or has 
another value is decoded. In the second decoding, a sig- 
nal in which a difference signal between a signal of inter- 
mediate level values of transparency and a binary signal 
in the case where transparency is 1 00% or has another 5 
value is decoded. The decoded sjqpyls nra' rM^rriirT 
posed with each other, whereby a multivalue signal of 
transparency can be decoded. 

Referring to Fig. 27(a), there is shown therein a block 
diagram of a picture decoding apparatus which is a w 
twenty-first embodiment of the invention, and Fig. 27(b) 
is a diagram showing an example of signal processing 
of the embodiment. Coded signal separating means 
2902 which receives a coded signal 2901 and outputs 
binary coded signals 2903 and 2905 is connected to 15 
decoding means 2904 which receives the binary coded 
signal 2903 and outputs a binary signal 2907, and also 
to decoding means 2906 which receives the binary 
coded signal 2905 and outputs a binary signal 2908. The 
decoding means 2904 and 2906 are connected to exclu- 20 
sive OR calculating means 2909 which receives the 
binary signals 2907 and 2908 and outputs a binary signal 
2910, and also to binary signal selecting means 2913 
which receives the binary signals 2917 and 2918 and 
outputs a binary signal 291 4. The exclusive OR calculat- 25 
ing means 2909 is connected to pixel value converting 
means 291 1 which receives the binary signal 2910 and 
outputs a converted signal 2912. The binary signal 
selecting means 2913 is connected to pixel value con- 
verting means 2915 which receives the binary signal 30 
2914 and outputs a converted signal 2916. The pixel 
value converting means 291 1 and means 2915 are con- 
nected to multi value signal decoding means 291 7 which 
receives the converted signals 2912 and 2916 and out- 
puts a multivalue signal 291 8. 35 

Next the operation of the embodiment will be 
described. 

The coded signal 2901 is a coded signal in which 
the coded signals 2005 and 2509 shown in Fig. 22 are 
integrated with each other. When the coded signal 290 1 40 
is input to the coded signal separating means 2902, the 
signal is separated into the binary coded signals 2903 
and 2905. When the binary coded signal 2903 is irput 
to the decoding means 2904, the signal is decoded to a 
binary signal and the binary signal 2907 is output. When as 
the binary coded signal 2903 is input to the decoding 
means 2906, the signal is decoded to a binary signal and 
the binary signal 2908 is output. The binary signals 2907 
and 2908 are input to the exclusive OR calculating 
means 2909. An exclusive OR is calculated from the two so 
input values, and the binary signal 2910 is output The 
binary signal 2910 is input to the pixel value converting 
means 291 1, the converted signal 2912 is output while 
substituting transparency of 100% into 0, and an inter- 
mediate value of transparency into 1 . When the binary ss 
signals 2917 and 2918 are input to the binary signal 
selecting means 2913, the signal in which 1 among the 
two input values occupies a smaller ratio is output as the 
binary signal 291 4. The binary signal 291 4 is input to the 
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pixel value converting means 2915, and the converted 
signal 2916 is output while substituting transparency of 
100% into 0. and the maximum value into 1. When the 
converted signals 2912 and 2916 are input to the multi- 
value signal decoding means, the two signals are added 
to each other andlhe multivalue signal 2918 is output. 

As seen from the above description, according to the 
embodiment, a multivalue signal decoding apparatus 
which decodes a signal coded by the coding apparatus 
of Fig. 20 is provided. In the first decoding, a binary 
coded signal in the case where transparency of pixel val- 
ues obtained from a picture signal is 100% or has 
another value is conducted. In the second decoding, a 
signal which is binarized and encoded in accordance 
with a threshold on the basis of the frequency distribution 
of intermediate values of transparency is decoded. The 
decoded signals are superimposed with each other, 
whereby a multivalue signal of transparency can be 
decoded. 

Referring now to Fig. 28, there is shown therein a 
block diagram of a picture coding apparatus which is a 
twenty-second embodiment of the invention. As shown 
in Fig. 28, blocking means 3002 which receives a pixel 
value signal 3001 and outputs a pixel block 3003. and 
effective block judging means 3005 which receives a 
pixel to be encoded position signal 3004 and outputs a 
control signal 3006 are connected to selecting means 
3007 which receives the pixel block 3003 and the control 
signal 3006 and outputs a pixel block to be encoded 
3008, The selecting means 3007 is connected to coding 
means 3009 which receives the pixel to be encoded 
block 3008 and outputs a coded signal 3010. 

Next, the operation of the embodiment will be 
described. 

When the pixel value signal 3001 which includes 
pixel value information of a picture is input to the blocking 
means 3002, the picture is divided into pixel blocks con- 
sisting of 1 6 x 16 pixels, and then output from the block- 
ing means 3002 as the pixel block 3003. 

The pixel to be encoded position signal 3004 is a 
signal obtained by conducting coding while judging from 
transparency of pixel values of a picture whether coding 
is to be conducted or not. (Transparency of 0% indicates 
a state where an opaque article exists and the back- 
ground cannot be seen, and transparency of 100% indi- 
cates a state where there is no article and the 
background can be seen as it is. An intermediate level 
value appears in the case where a translucent article 
made of glass or the like exists, or in a boundary between 
articles.) 

When the pixel to be encoded position signal 3004 
is input to the effective block judging means 3005, a block 
which is synchronized with the pixel block 3003 is 
checked to judge whether it includes a pixel value to be 
encoded or not. The effective block judging means 3005 
outputs a signal based on the judgment as the control 
signal 3006. When the control signal 3006 and the pixel 
block 3003 are input to the selecting means 3007, if the 
effective block judging means 3005 judges that the pixel 
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block 3003 includes a pixel value to be encoded, the 
selecting means 3007 outputs the pixel block 3003 as 
the pixel to be encoded block 3008. If the effective block 
judging means 3005 judges that the pixel block 3003 
does not include a pixel value to be encoded, the select- 
ing means 3007 does not outfju^tt^ix^ti^e3ncoded 
block 3008. When the pixel tifbe encoded block 3008 
output from the selecting means 3007 is input to the cod- 
ing means 3009, muttivalue-coding which uses DCT is 
conducted and the coded signal 3010 is output. 

Fig. 29 is a diagram showing pixel blocking in the 
embodiment. The solid figure in the left portion of Fig. 29 
indicates pixels which are judged to be encoded in 
accordance with transparency of pixel values. Dotted 
blocks in the right portion of Fig. 29 indicate pixel blocks 
to be encoded which are divided on the basis of informa- 
tion of the pixels to be encoded. 

In the embodiment, it is possible to uniquely identify 
from the pixel to be encoded position signal not only a 
pixel block which includes a pixel to be encoded, but also 
a pixel block which does not include a pixel to be 
encoded. Therefore, the apparatus of the embodiment is 
a picture signal coding apparatus in which coding of such 
a pixel block can be omitted so that the coding efficiency 
is improved. 

The multivalue coding in the coding means 3009 
employs DCT The method of the coding is not restricted 
to this. Alternatively, multivalue coding in which orthog- 
onal transformation is combined with entropy coding may 
be employed. In short, any multivalue coding method 
may be employed as far as it can efficiently conduct mul- 
tivalue coding. 

A pixel block has a structure of 16 x 16 pixels. The 
structure of a pixel block is not restricted to this, and may 
be 32 x 32 pixels. In short, any pixel structure may be 
employed as far as it can improve the coding efficiency 
As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 30, there is shown therein a block 
diagram of a picture coding apparatus which is a twenty- 
third embodiment of the invention. Large blocking means 
3102 which receives a pixel value signal 3101 and out- 
puts a large pixel block 31 03, small blocking means 3 1 04 
which receives the pixel value signal 3101 and outputs 
a small pixel block 3105, effective large block judging 
means 3107 which receives a pixel to be encoded posi- 
tion signal 3106 and outputs a control signal 3108, and 
effective small block judging means 3109 which receives 
the pixel to be encoded position signal 3106 and outputs 
a control signal 31 10 are connected to selecting means 
3111 which receives the large pixel block31 03. the small 
pixel block 3105, and the control signals 3108 and 31 10 
and outputs a pixel block to be encoded 3112. The 
selecting means 3111 is connected to coding means 
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3113 which receives the pixel block to be encoded 3112, 
and the control signals 3108 and 31 10 and outputs a 
coded signal 3114. 

Next, the operation of the embodiment will be 
described. 

When the pixel value signal 3101 which includes 
pixel value information of a picture is input to the large 
blocking means 3102, the picture is divided into large 
pixel blocks consisting of 1 6 x 16 pixels, and then output 
as the large pixel block 3 1 03. When the pixel value signal 
3101 is input to the small blocking means 3104, the pic- 
ture is divided into small pixel blocks consisting of 8 x 8 
pixels, and then output as the small pixel block 3105. 

The pixel to be encoded position signal 3106 is a 
signal obtained by conducting coding wile judging from 
transparency of pixel values of a picture whether coding 
is to be conducted or not 

When the pixel to be encoded position signal 3106 
is input to the effective large block judging means 3107, 
a block which is synchronized with the large pixel block 
3103 is checked to judge whether it includes a pixel value 
to be encoded or not. The effective large block judging 
means 3107 outputs a signal based on the judgment as 
the control signal 3108. When the pixel to be encoded 
position signal 3106 is input to the effective small block 
judging means 3109, a block which is synchronized with 
the small pixel block 31 05 is checked to judge whether it 
includes a pixel value to be encoded or not. The effective 
small block judging means 3109 outputs a signal based 
on the judgment as the control signal 31 10. 

When the large pixel block 3103, the small pixel 
block 3105, and the control signals 3108 and 31 10 are 
input to the selecting means 31 1 1 , the large pixel block 
3 1 03 and the small pixel block 3 1 05 are controlled by the 
control signals 3108 and 31 10 and the pixel block to be 
encoded 31 12 is output. Specifically, if it is judged that 
all the four small pixel blocks contained in the large pixel 
block 3103 include a pixel to be encoded, the large pixel 
block 3103 is output as the pixel block to be encoded 
3112 from the selecting means 311 1. In the case other 
than the above, if it is judged that at least one of the four 
small pixel blocks contained in the large pixel block 3 103 
includes a pixel to be encoded, only the small pixel block 
3105 which is judged that it includes a pixel to be 
encoded is output as the pixel block to be encoded 3112 
from the selecting means 3111, 

When the pixel block to be encoded 3112 and the 
control signals 3108 and 3110 are input to the coding 
means 31 13, the pixel block to be encoded 31 12 is con- 
trolled by the control signals 3108 and 3110 and the 
coded signal 31 14 is output Specifically, if it is judged 
from the control signals 3108 and 31 10 that all the four 
small pixel blocks contained in the large pixel block3103 
include a pixel to be encoded, the pixel block to be 
encoded 31 12 is subjected to multivalue coding accord- 
ing to DCT which corresponds to the large pixel block, 
and the coding means 31 13 outputs the coded signal 
3 1 1 4. In the case other than the above, if it is judged from 
the control signals 31 08 and 31 10 that at least one of the 
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four small pixel blocks contained in the large pixel block 
3103 includes a pixel to be encoded, the pixel block to 
be encoded 3112 is subjected to multivalue coding 
according to DCT which corresponds to the small pixel 
block, and the coding means 31 13 outputs the coded sig- 5 
nal 31 14. In the other case, thg^terfsiflMSnTis not 
. output. — 

Referring to Fig. 31, there is shown therein a dia- 
gram showing large pixel blocking and small pixel block- 
ing of the embodiment. It will be seen that, when each 10 
large pixel block in the left portion of Fig. 31 is divided 
into small pixel blocks in the right portion of the figure, 
coding of the three empty small pixel blocks among the 
four small pixel blocks, can be omitted. 

According to the embodiment a picture signal cod- is 
ing apparatus is provided in which a picture is divided 
into large pixel blocks of the same area, the large pixel 
blocks are further divided into small pixel blocks, and 
hence coding of a small pixel block which is included in 
the large pixel block and not required to be encoded can 20 
be omitted, thereby improving the coding efficiency. 

The multivalue coding in the coding means 3113 
employs DCT. The method of the coding is not restricted 
to this. Alternatively, multivalue coding in which orthog- 
onal transformation is combined with entropy coding may 25 
be employed. In short, any multivalue coding method 
may be employed as far as it can efficiently conduct mul- 
tivalue coding. 

A pixel block has a structure of 1 6 x 1 6 pixels. The 
structure of a large pixel block is not restricted to this, 30 
and may be 32 x 32 pixels. To comply with this, a small 
pixel block has a structure of 4 x 4 pixels. The structure 
of a small pixel block is not restricted to this, and may be 
8x8 pixels. In short, any pixel structure may be 
employed as far as it can improve the coding efficiency. 35 

As the means for determining whether a pixel is to 
be encoded or not transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 40 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 32, there is shown therein a block 
diagram of a picture coding apparatus which is a twenty- 
fourth embodiment of the invention. Block slicing means 45 
3202 which receives a pixel value signal 3201 and out- 
puts a pixel block slice 3203, and blocking start position 
judging means 3205 which receives a pixel to be 
encoded position signal 3204 and outputs a control sig- 
nal 3206 are connected to blocking means 3207 which so 
receives the pixel block slice 3203 and the control signal 
3206 and outputs a pixel block to be encoded 3208. The 
blocking means 3207 is connected to coding means 
3209 which receives the pixel block to be encoded 3208 
and outputs a coded signal 32 1 0. 55 

Next the operation of the embodiment will be 
described. 

When the pixel value signal 3201 which includes 
pixel value information of a picture is input to the block 



slicing means 3202, the picture is sliced with a height of 
16 pixels to be divided into pixel block slice, and then 
output as the pixel block slice 3203. 

The pixel to be encoded position signal 3204 is a 
signal obtained by conducting coding while judging from 
transparency of pixel values of a picture whether coding 
is to be conducted or not. 

When the pixel to be encoded position signal 3204 
is input to the blocking start position judging means 3205, 
for the pixel block slice 3203, the control signal 3206 
which corresponds to the start position of pixel blocking 
consisting of 16 x 16 pixels is output from the blocking 
start position judging means 3205. When the pixel block 
slice 3203 and the control signal 3206 are input to the 
blocking means 3207, pixel blocking consisting of 16 x 
1 6 pixels is conducted on the pixel block slice 3203. Spe- 
cifically, if it is judged from the control signal 3206 that 
the pixel block slice 3203 includes a pixel to be encoded, 
pixel blocking consisting of 16 x 16 pixels is conducted 
with starting from a position where a pixel to be encoded 
is first detected. Among pixel blocks from which a pixel 
block slice is separated, only a pixel block which is judged 
to include a pixel value to be encoded is sequentially out- 
put as the pixel block to be encoded 3208 from the block- 
ing means 3207. When the pixel block to be encoded 
3208 is input to the coding means 3209, multivalue cod- 
ing according to DCT is conducted and the coded signal 
3210 is output. 

Fig. 33 is a diagram showing pixel blocking in the 
embodiment. As described with reference to Fig. 29, 
when blocking is conducted by the pixel blocking of the 
twenty-second embodiment, pixel blocks to be encoded 
are eleven pixel blocks shown in the right portion of the 
figure. In contrast, when blocking is conducted by the 
pixel blocking of the present embodiment as shown in 
Fig. 33, pixel blocks to be encoded are nine pixel blocks 
shown in the lower portion of the figure. From the above, 
it will be seen that the pixel value coding method of the 
twenty-fourth embodiment shown in Fig. 32 can reduce 
the number of pixel blocks to be encoded, by two. 

The embodiment can provide a picture signal coding 
apparatus which conducts pixel blocking so that the start 
position of pixel blocks to be encoded is located at a pixel 
position that is to be first detected in the horizontal direc- 
tion, and hence there is a case where the number of pixel 
blocks to be encoded is made smaller than that in the 
first embodiment, thereby further improving the coding 
efficiency. 

The multivalue coding in the coding means 3209 
employs DCT. The method of the coding is not restricted 
to this. Alternatively, multivalue coding in which orthog- 
onal transformation is combined with entropy coding may 
be employed. In short, any multivalue coding method 
may be employed as far as it can efficiently conduct mul- 
tivalue coding. 

The height of the pixel block slice is set to be 1 6 pix- 
els. The height is not restricted to this, and may be set 
to be 32 pixels. To comply with this, a pixel block has a 
structure of 16 x 16 pixels. The structure of a pixel block 
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is not restricted to this, and may be 32 x 32 pixels. In 
short, any pixel structure may be employed as far as it 
can improve the coding efficiency. 

As the means for determining whether a pixel is to 
be encoded or not, transparency ofjpjxfibfafcjes is used, s 
The means is not restri oto J -tcrtlu^. All urnatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. ro 

Referring to Fig. 34, there is shown therein a block 
diagram of a picture coding apparatus which is a twenty- 
fifth embodiment of the invention. Horizontal effective 
pixel range detecting means 3305 which receives a pixel 
to be encoded position signal 3304 and outputs a control is 
signal 3306, and vertical effective pixel range detecting 
means 3307 which receives the pixel to be encoded posi- 
tion signal 3304 and outputs a control signal 3308 are 
connected to selecting means 3302 which receives a 
pixel value signal 3301 and outputs a single pixel block 20 
to be encoded 3303. The selecting means 3302 is con- 
nected to coding means 3309 which receives the single 
pixel block to be encoded 3303 and outputs a coded sig- 
nal 3310. 

Next, the operation of the embodiment will be 25 
described. 

The pixel to be encoded position signal 3304 is a 
signal obtained by conducting coding while judging from 
transparency of pixel values of a picture whether coding 
is to be conducted or not. 30 

When the pixel to be encoded position signal 3304 
is input to the horizontal effective pixel range detecting 
means 3305, from the pixel to be encoded position signal 
3304, the horizontal effective pixel range detecting 
means 3305 outputs the control signal 3306 based on 35 
the pixel position to be decoded which is to be first 
detected in the horizontal direction and that which is to 
be last detected. When the pixel to be encoded position 
signal 3304 is input to the vertical effective pixel range 
detecting means 3307, from the pixel to be encoded 40 
position signal 3304, the vertical effective pixel range 
detecting means 3307 outputs the control signal 3308 
based on the pixel position to be decoded which is to be 
first detected in the horizontal direction and that which is 
to be last detected. 45 

The pixel value signal 3301 including pixel value 
information of a picture and the control signals 3306 and 
3308 are input to the selecting means 3302, for the pixel 
value signal 330 1 , a minimum single pixel block including 
a pixel value to be encoded is configured by the control so 
signals 3306 and 3308, and the selecting means 3302 
outputs the single pixel block to be encoded 3303. Even 
when the single pixel block to be encoded 3303 is input 
to the coding means 3309 which conducts multivalue 
coding in accordance with Wavelet transform coding that ss 
cannot encode plural blocks, it is possible to conduct 
multivalue coding in accordance with the above-men- 
tioned coding because the block to be encoded is a sig- 



nal pixel block. The coding means 3309 outputs the 
coded signal 3310. 

Fig. 35 is a diagram showing single blocking in the 
embodiment As shown in the right portion of Fig. 35, it 
will be seen that coding of the hatched region can be 
omitted by configuring a minimum single pixel block 
including a pixel value to be encoded. 

As seen from the above description, according to the 
embodiment, a picture signal coding apparatus is pro- 
vided in which a minimum single pixel block including a 
pixel value to be encoded is configured so that even 
when a pixel value signal is to be encoded by a coding 
method which cannot encode a pixel value signal con- 
sisting of plural blocks, coding is enabled. 

The multivalue coding in the coding means 3309 
employs Wavelet coding. The method of the coding is 
not restricted to this. Alternatively, multivalue coding in 
which orthogonal transformation is combined with 
entropy coding may be employed. In short, any multi- 
value coding method may be employed as far as it can 
efficiently conduct multivalue coding. 

As the means for determining whether a pixel is to 
be encoded or not, transparency of pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Referring to Fig. 36, there is shown therein a block 
diagram of a picture coding apparatus which is a twenty- 
sixth embodiment of the invention. Blocking means 3402 
which receives a pixel value signal 3401 and outputs a 
pixel block 3403, and effective block judging means 3405 
which receives a pixel to be encoded position signal 3404 
and outputs a control signal 3406 are connected to 
selecting means 3407 which receives the pixel block 
3403 and the control signal 3406 and outputs a pixel 
block to be encoded 3408. The selecting means 3407, 
and pixel value generating means 3409 which receives 
the pixel to be encoded position signal 3404 and the pixel 
Wockto be encoded 3408 and outputs a high frequency 
component reduction signal 3410 are connected to 
blocking means 341 1 which receives the pixel to be 
encoded position signal 3404, the pixel block to be 
encoded, and the high frequency component reduction 
signal 341 0 and outputs a pixel blockto be encoded 341 2 
including the high frequency component reduction sig- 
nal. The blocking means 341 1 is connected to coding 
means 3413 which receives the pixel block to be 
encoded 3412 including the high frequency component 
reduction signal and outputs a coded signal 3414. 

Next, the operation of the embodiment will be 
described. 

When the pixel value signal 3401 which includes 
pixel value information of a picture is input to the blocking 
means 3402, the picture is divided into pixel blocks which 
are arranged in a lattice or in horizontal and vertical direc- 
tions, and then output as the pixel block 3403. 
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The pixel to be encoded position signal 3404 is a 
signal obtained by conducting coding while judging from 
transparency of pixel values of a picture whether coding 
is to be conducted or not. 

When the pixel to be encoded pp sition sig nal 3404 s 
is input to the effective bloc^Mdgin§ifweans-3405 r a block 
which is synchronized with the pixel block 3403 is 
checked to judge whether it includes a pixel value to be 
encoded or not. The effective block judging means 3405 
outputs a signal based on the judgment as the control 10 
signal 3406. When the control signal 3406 and the pixel 
block 3403 are input to the selecting means 3407, if the 
effective block judging means 3405 judges that the pixel 
block3403 includes a pixel value to be encoded, the pixel 
block 3403 is output from the selecting means 3407 as is 
the pixel block to be encoded 3408. If the effective block 
judging means 3405 judges that the pixel block 3403 
does not include a pixel value to be encoded, the pixel 
block 3403 is not output from the selecting means 3407. 
When the pixel block to be encoded 3408 output from 20 
the selecting means 3407 and the pixel to be encoded 
position signal 3404 are input to the pixel value generat- 
ing means 3409, the average value of pixel values of pix- 
els to be encoded which are included in the pixel block 
to be encoded 3408 is calculated and then output from 25 
the pixel value generating means 3409 as the high fre- 
quency component reduction signal 3410. When the 
high frequency component reduction signal 3410, the 
pixel block to be encoded 3408, and the pixel to be 
encoded position signal 3404 are input to the blocking 30 
means 3411, the average value is substituted into the 
value of a pixel which is included in the pixel block to be 
encoded and is not to be encoded, and the blocking 
means 341 1 outputs the pixel block to be encoded 3412 
which includes the high frequency component reduction 35 
signal. When the pixel block to be encoded 3412 which 
includes the high frequency component reduction signal 
is input to the coding means 3413, multivalue coding in 
accordance with DCT is conducted, and the coding 
means 3413 outputs the coded signal 3414. ao 

Fig. 37 is a diagram showing a process of storing a 
value for reducing high frequency components into the 
value of a pixel which is not a pixel to be encoded, in the 
embodiment. As shown in the right portion of Fig. 37, 
pixels to be encoded are indicated by the solid region, 45 
pixels not to be encoded are indicated by the dotted 
region. The average value which can reduce the high fre- 
quency components is substituted into the pixels not to 
be encoded which are indicated by the dotted region. 

As seen from the above description, according to the so 
embodiment, a picture signal coding apparatus is pro- 
vided in which a value which can reduce the high fre- 
quency components of a pixel block to be encoded is 
substituted into a pixel not to be which is included in the 
pixel block to be encoded, whereby the high frequency ss 
components can be reduced. The method in which the 
average value which can reduce the high frequency com- 
ponents of a pixel block to be encoded is substituted into 
a pixel not to be encoded which is included in the pixel 



block to be encoded may be applied to the other embod- 
iments. 

The multivalue coding in the coding means 3413 
employs DCT. The method of the coding is not restricted 
to this. Alternatively, multivalue coding in which orthog- 
onal transformation is combined with entropy coding may 
be employed. In short, any multivalue coding method 
may be employed as far as it can efficiently conduct mul- 
tivalue coding. 

In the high frequency component reducing method 
of the pixel value generating means, the average value 
of pixel values to be encoded is employed. The value to 
be employed is not restricted to this, and an interpolation 
value may be employed. In short, any value may be 
employed as far as it can reduce high frequency compo- 
nents. 

As the means for determining whether a pixel is to 
be encoded or not, transparency of a pixel values is used. 
The means is not restricted to this. Alternatively, bright- 
ness on which information of transparency of pixel values 
is superposed may be used. In short, any means may 
be used as far as it includes information of a transparent 
state of a pixel value. 

Claims 

1 . A picture coding apparatus comprising : 

representative picture selecting means (12) 
for selecting a representative picture signal which is 
a representative picture of each scene, from an input 
signal which has a plurality of pctures to be 
encoded; 

representative picture coding means (15) for 
generating a representative picture coded signal by 
encoding said representative picture signal, and 
determining a first addition control signal which is 
used in reference relationships in the case where the 
representative picture is used as a reference picture 
of motion compensation predictive coding of a non- 
representative picture which is not the representa- 
tive picture; 

decoding means (21) for decoding said rep- 
resentative picture coded signal, and outputting the 
decoded signal as a representative picture decoded 
signal; 

reference relationship adding means (32) for 
generating reference relationship additional infor- 
mation on the basis of said first addition control sig- 
nal and a second addition control signal; 

reference signal selecting means (23) for 
storing said representative picture decoded signal, 
selecting a representative picture decoding refer- 
ence signal which is the representative picture 
decoded signal corresponding to each nonrepre- 
sentative picture signal, outputting said representa- 
tive picture decoding reference signal, and 
outputting said second additional control signal 
which is used in addition of reference relationships 
of the representative picture, to said reference rela- 
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tionship adding means; 

motion parameter detecting means (25) for 
detecting a motion parameter between pictures 
used in motion compensation, from said nonrepre- 
sentative picture signal and said representative pic- 
ture decoding refet^^JSisSiSn? 

coded signal generating means (1 7) for com- 
bining said motion parameter, said representative 
picture coded signal, and said reference relationship 
additional information with each other, and output- 
ting the combined signal as a coded output signal. 



2. A picture coding apparatus according to claim 1, 
wherein 

said reference relationship adding means is 
(32) determines significance of a representative pic- 
ture on the basis of predetermined conditions, adds 
information of the significance to said reference rela- 
tionship additional information, and outputs an addi- 
tion result. go 

3. A picture decoding apparatus comprising: 

representative picture extracting means 
(102) for receiving said coded output signal output 
from said coded signal generating means (1 7) of the 25 
picture coding apparatus according to claim 1 , as a 
coded input signal, and extracting a coded repre- 
sentative picture signal from said coded input signal; 

representative picture decoding means (104) 
for decoding said coded representative picture sig- 30 
nal, and outputting the decoded signal as a decoded 
representative picture signal; 

representative picture reference relationship 
extracting means (112) for extracting reference rela- 
tionships of representative picture from said coded 3s 
input signal, and outputting said reference relation- 
ships as reference relationship additional informa- 
tion; 

decoded signal output controlling means 
(1 1 4) for determining an output control of a decoded 40 
signal on the basis of said reference relationship 
additional information, and outputting an output con- 
trol signal; and 

a delay memory (106) for storing said 
decoded representative picture signal, and output- 45 
ting a decoded output signal on the basis of said out- 
put control signal. 

4. A picture decoding apparatus comprising: 

significance judging means (122) for receiv- so 
ing said coded output signal output from said coded 
signal generating means (17) of the picture coding 
apparatus according to claim 2, as a coded input sig- 
nal, and extracting significance of the representative 
picture from said coded input signal; 55 

representative picture extracting means 
(102) for extracting a coded representative picture 
from said coded input signal on the basis of said sig- 
nificance and a predetermined value for said signif- 



icance; 

representative picture decoding means (104) 
for decoding said coded representative picture sig- 
nal, and outputting the decoded signal as a decoded 
representative picture signal; and 

a delay memory (106) for storing said 
decoded representative picture signal, and output- 
ting said signal as a decoded signal. 

5. A picture decoding apparatus comprising: 

r epresentative picture extracting means 
(102) for receiving said coded output signal output 
from said coded signal generating means (1 7) of the 
picture coding apparatus according to claim 1, as a 
coded input signal, and extracting a coded repre- 
sentative picture signal from said coded input signal; 

first representative picture decoding means 
(104) for decoding said coded representative picture 
signal, and outputting the decoded signal as a 
decoded representative picture signal; 

a delay memory (106) for storing said 
decoded representative picture signal, and output- 
ting said signal as a decoded output signal; 

motion parameter extracting means (132) for 
extracting a motion parameter from said coded input 
signal; 

motion compensating means (134) for 
motion compensating said decoded representative 
picture signal which is an output of said delay mem- 
ory (1 06), and outputting the compensated signal as 
a motion compensation decoded signal; and 

decoded signal selecting means (136) for 
selecting said motion compensation decoded signal 
on the basis of predetermined conditions, and out- 
putting said selected motion compensation decoded 
signal and said decoded output signal. 

6. A picture decoding apparatus comprising: 

predictive coded picture counting means 
(142) for receiving said coded output signal output 
from said coded signal generating means (1 7) of the 
picture coding apparatus according to claim 1, as a 
coded input signal, counting predictive coded pic- 
tures from said coded input signal, and generating 
a time interval control signal which becomes a time 
interval of an output of a representative picture, on 
the basis of a count result; 

representative picture extracting means 
(102) for extracting a coded representative picture 
signal from said coded input signal; 

representative picture decoding means (1 04) 
for decoding said coded representative picture sig- 
nal, and outputting the decoded signal as a decoded 
representative picture signal; and 

a delay memory (106) for storing said 
decoded representative picture signal, and output- 
ting said signal as a decoded signal on the basis of 
said time interval control signal. 
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7. 



A picture coding apparatus comprising: 

layer significance judging means (1002) for 
receiving signals for a picture divided into two layers, 
as a layer-1 input signal and a layer-2 input signal, 
determining significance of each of said layer-1 input 
signal and saidjagafa2 ioptitsignal. on the basis of 
predetermined "conditions, and outputting deter- 
mined significance as layer-1 significance additional 
information and layer-2 significance additional infor- 
mation; 

layer-1 coding means (1012) for encoding 
said layer-1 input signal, and outputting the coded 
signal as a layer-1 coded signal; 

layer-1 coded signal generating means 
(1014) for generating a layer-1 coded output signal 
which is a coded signal of a layer 1 , on the basis of 
said layer-1 coded signal and said layer-1 signifi- 
cance additional information; 

layer-2 coding means (1022) for encoding 
said layer-2 input signal, and outputting the coded 
signal as a layer-2 coded signal; and 

layer-2 coded signal generating means 
(1024) for generating a layer-2 coded output signal 
which is a coded signal of a layer 2, on the basis of 
said layer-2 coded signal and said layer-2 signifi- 
cance additional information. 
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8. A picture decoding apparatus comprising: 

layer significance judging means (201) for 
receiving said layer-1 coded output signal and said 30 
layer-2 coded output signal which are generated by 
said picture coding apparatus according to claim 7, 
as a layer-1 coded input signal and a layer-2 coded 
input signal, extracting significance of the layer 1 
from said layer-1 coded output signal, and signifi- 35 
cance of the layer 2 from said layer-2 coded output 
signal, and, when the significance is equal to or 
larger than a predetermined value, generating a 
layer-1 decoding control signal and a layer-2 decod- 
ing control signal which are used for conducting a 40 
control so as to decode the layers; 

layer-1 decoding means (212) for decoding 
said layer-1 coded input signal on the basis of said 
layer-1 decoding control signal, and outputting the 
decoded signal as a layer-1 decoded signal; 45 

layer-2 decoding means (222) for decoding 
said layer-2 coded input signal on the basis of said 
layer-2 decoding control signal, and outputting the 
decoded signal as a layer-2 decoded signal; and 

layer synthesizing means (202) for synthesiz- so 
ing said layer-1 decoded signal with said layer-2 
decoded signal, and outputting a synthesis result as 
a decoded output signal. 

9. A picture decoding apparatus according to claim 8. ss 
wherein 

said layer significance judging means (201) 
outputs one of said layer-1 decoding control signal 
and said layer-2 decoding control signal, on the 
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basis of significance of the layer 1 and significance 
of the layer-2. 

1 0. A picture decoding apparatus which receives coded 
output signals as a layer-1 coded input signal, a 
layer-2 coded input signal, and a layer-3 coded input 
signal, respectively, said coded output signals being 
obtained by dividing a picture into three layers, and 
coding the three layers by said picture coding appa- 
ratus according to claim 1 , said coded output signals 
being output from said coded signal generating 
means of said picture coding apparatus, wherein 
said picture decoding apparatus comprises: 

layer-1 decoding means (312) for decoding 
said layer-1 coded input signal, outputting the 
decoded signal as a layer-1 decoded signal, and out- 
putting a first decoding state signal; 

layer-2 decoding means (322) for decoding 
said layer-2 coded input signal, outputting the 
decoded signal as a layer-2 decoded signal, and out- 
putting a second decoding state signal; 

layer-3 decoding means (332) for decoding 
said layer-3 coded input signal, outputting the 
decoded signal as a layer-3 decoded signal, and out- 
putting a third decoding state signal; 

predetermined-number judging means (301) 
for, when layers the number of which is larger than 
a predetermined number are newly decoded, out- 
putting first, second, and third output control signals, 
on the basis of said first, second, and third decoding 
state signals; 

a layer-1 delay memory (316) for storing said 
layer-1 decoded signal, and outputting said layer-1 
decoded signal as a layer-1 decoded output signal 
on the basis of said first output control signal output 
from said predetermined-number judging means 
(301); 

a layer-2 delay memory (326) for storing said 
layer-2 decoded signal, and outputting said layer-2 
decoded signal as a layer-2 decoded output signal 
on the basis of said second output control signal out- 
put from said predetermined-number judging means 
(301); 

a layer-3 delay memory (336) for storing said 
layer-3 decoded signal, and outputting said layer-3 
decoded signal as a layer-3 decoded output signal 
on the basis of said third output control signal output 
from said predetermined-number judging means 
(301); and 

layer synthesizing means (308) forsynthesiz- 
ing said layer-1 decoded output signal, said layer-2 
decoded output signal, and said layer-3 decoded 
output signal with each other, and outputting a syn- 
thesis result as a decoded output signal. 

. A picture decoding apparatus comprising: 

layer-1 decoding means (212) for receiving 
said layer-1 coded output signal generated by said 
picture coding apparatus according to claim 7, as a 
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layer-1 coded input signal, decoding said layer-1 
coded input signal, outputting the decoded signal as 
a layer-1 decoded signal; 

layer-2 decoding means (222) for receiving 
said layer-2 coded output signal generated by said 
oichim fyptinfl gpp^-fi ic according to claim 7, as a 
layer-2 coded input signal, decoding said layer-2 
coded input signal in a method which is different 
from a decoding method employed in said layer-1 
decoding means, outputting the decoded signal as 
a layer-2 decoded signal; and 

layer selecting means (231) for selecting one 
of said layer-1 decoded signal and said layer-2 
decoded signal on the basis of predetermined con- 
ditions, and outputting the selected signal as a 
decoded output signal. 
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12. A picture coding apparatus comprising: 

binarizing means (2002) for binarizing trans- 
parency information for each of pixels of a picture on 20 
the basis of a predetermined value; 

binary coding means (2004) for binary- 
encoding the transparency information binarized by 
said binarizing means; 

judging means (2203) for judging whether or 25 
not the transparency information for each of said pix- 
els is to be muftivalue-encoded on the basis of the 
transparency information, for each of the pixels; and 

multivalue coding means (2206) for multi- 
value-encoding the transparency information which 30 
is judged by said judging means that the transpar- 
ency information is to be multivalue-encoded. 
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13. A picture coding apparatus according to claim 12, 
wherein 

said judging means judges (2306, 2506) 
whether or not the transparency information for each 
of said pixels is to be multivalue-encoded on the 
basis of the transparency information binarized by 
said binarizing means, for each of the pixels. 40 

14. A picture decoding apparatus comprising: 

binary decoding means (2724, 2704, 2802) 
for binary-decoding the transparency information 
which is binary-encoded by the binary coding means 45 
(2004) of said picture coding apparatus according to 
claim 12; 

multivalue decoding means (2731, 2709, 
2809) for multivalue<lecoding the transparency 
information which is multivalue-encoded by the mul- so 
tivalue coding means of said picture coding appara- 
tus according to claim 12; and 

generating means (2733, 2713, 2806) for 
generating the transparency information for each of 
the pixels of said picture, with using the transparency ss 
information binary-decoded by said binary decoding 
means and the transparency information multivalue- 
decoded by said multivalue decoding means. 



15. A picture coding apparatus comprising: 

judging means (3005) forjudging whether or 
not each pixel of a picture is to be encoded on the 
basis of transparency information for the pixel; and 

coding means for encoding each pixel which 
is judged by said judging means that the pixel is to 
be encoded. 

16. A picture coding apparatus comprising: 
blocking means (3002) for dividing a picture 

into pixel blocks each of which has a predetermined 
number of pixels; 

judging means for judging whether or not 
each pixel of said picture is to be encoded on the 
basis of transparency information for the pixel; 

effective blockjudging means (3005) forjudg- 
ing whether or not each of said pixel blocks includes 
at least a pixel which is judged by said judging 
means that the pixel is to be encoded; 

selecting means (3007) for selecting the pixel 
blocks each of which is judged to include the pixel 
to be encoded; and 

coding means (3009) for encoding the pixel 
blocks selected by said selecting means. 

17. A picture coding apparatus comprising: 

large blocking means (3102) for dividing a 
picture into large pixel blocks each of which has a 
predetermined number of pixels; 

judging means for judging whether or not 
each pixel of said picture is to be encoded on the 
basis of transparency information for the pixel; 

effective large blockjudging means (3107) for 
judging whether or not each of said large pixel blocks 
includes at least a pixel which is judged by said judg- 
ing means that the pixel is to be encoded; 

small blocking means (3104) for dividing 
each large pixel block which includes at least a pixel 
to be encoded into small pixel blocks each of which 
has a predetermined number of pixels which is 
smaller in number than the pixels of the large pixel 
block; 

effective small block judging means (3109) 
for judging whether or not each of said small pixel 
blocks includes at least a pixel which is judged by 
said judging means that the pixel is to be encoded; 

selecting means (3111) for selecting the 
large pixel blocks each of which includes at least a 
pixel to be encoded or the small pixel blocks each of 
which includes at least a pixel to be encoded; 

coding means (3113) for encoding the pixels 
of each large pixel block or each small pixel block 
selected by said selecting means. 

18. A picture coding apparatus comprising: 

block slicing means (3202) for dividing a pic- 
ture into pixel block slices each of which has a con- 
stant height and includes a predetermined number 
of pixels; 
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judging means for judging whether or not 
each pixel of said picture is to be encoded on the 
basis of transparency information for the pixel; 

blocking start position judging means (3205) 
for detecting a start PQsitoijnja horizontal direction 
of each pijrtnlorlr olicc yyhich is judged to include 
the pixel to be encoded; 

blocking means (3207) for dividing each pixel 
block slice which is judged to include the pixel to be 
encoded into pixel blocks by a width of a predeter- 
mined number of pixels from the start position; and 

coding means (3209) for encoding each pixel 
block including the pixel to be encoded. 

19. A picture coding apparatus comprising: 

judging means for judging whether or not 
each pixel of a picture is to be encoded on the basis 
of transparency information for the pixel; 

horizontal effective pixel range detecting 
means (3305) for detecting positions which are start 
and end points in a horizontal direction of the pixels 
each of which is judged by said judging means that 
the pixel is to be encoded; 

vertical effective pixel range detecting means 
(3307) for detecting positions which are start and 
end points in a vertical direction of pixels each of 
which is judged by said judging means that the pixel 
is to be encoded; 

selecting means (3302) for selecting the pix- 
els which are included in a range designated by said 
positions which are the start and end points in the 
horizontal direction and said positions which are the 
start and end points in the vertical direction; and 

coding means (3309) for encoding the pixels 
selected by said selecting means. 



second pixel blocks each of which is constituted by 
combining each pixel to be encoded which is 
included in each of the first pixel blocks selected by 
said selecting means (3407) with the each pixel 
5 * which is included in the first pixel block and is sub- 
stituted by said calculated value; and 

coding means (341 3) for encoding the pixels 
of each first pixel block or each second pixel block. 

10 21. A picture coding apparatus comprising: 

representative picture selecting means (12) 
for selecting a representative picture from a picture 
group which includes a plurality of pictures; 

coding means for encoding each of the pic- 
is tures which are included in said picture group, with 
using the representative picture; and 

signal generating means (17) for generating 
a signal including the pictures encoded by said cod- 
ing means, and for generating a signal including cod- 
20 ing information relating to the representative picture 
which is used for each of the encoded pictures 
included in the signal; 

said signal generating means being able to 
separately send said signal including the encoded 
25 pictures and said signal including the coding infor- 
mation relating to the representative picture. 



20. A picture coding apparatus comprising: 

first blocking means (3402) for dividing a pic- 
ture into first pixel blocks each of which has a pre- 
determined number of pixels; 

judging means for judging whether or not 
each pixel of said picture is to be encoded on the 
basis of transparency information for the pixel; 

effective block judging means (3405) forjudg- 
ing whether or not each of said first pixel blocks 
includes at least a pixel which is judged by said judg- 
ing means that the pixel is to be encoded; 

selecting means (3407) for selecting the first 
pixel blocks each of which is judged to include the 
pixel to be encoded; 

pixel value generating means (3409) for cal- 
culating each pixel value to be encoded which is 
included in each of the first pixel blocks selected by 
said selecting means, by a predetermined function 
which can reduce high frequency components, and 
substituting the calculated value into each pixel 
which is included in the first pixel block and is not the 
pixel to be encoded; 

second blocking means (34 1 1 ) for generating 



22. A picture coding apparatus according to claim 21, 
wherein . 

30 said coding information relating to the repre- 

sentative picture can be used in each coding of pic- 
tures included in a picture group other than the 
picture group from which the representative picture 
is selected. 

35 

23. A picture coding apparatus according to claim 22, 
wherein 

said picture coding apparatus further com- 
prises: 

« representative picture storing means for stor- 

ing at least one set of an identifier of the represent- 
ative picture for the picture group preceding said 
picture group which is to be processed, and picture 
information of the representative picture for the iden- 

45 tifier; and 

representative picture coding means (15) for 
encoding said representative picture; 

said representative picture selecting means 
(13) selects the representative picture for said pic- 
so ture group which is to be processed, from the picture 
group which is to be processed or said representa- 
tive picture storing means, 

when said representative picture is selected 
from the picture group which is to be processed, said 
55 representative picture storing means stores the 
identifier of the representative picture and the pic- 
ture information of the representative picture, 

said coding means obtains motion parame- 
ters to be used in motion compensation for each of 
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the pictures included in said picture group which is 
to be processed, with reference to the picture infor- 
mation of the representative picture selected by said 
representative picture selecting means, and 
encodes the motion parameters. . 5 

^.whnr t^aa^epresentative picture is selected 
from the picture group which is to be processed, said 
signal generating means generates the signal 
including the representative picture which is 
selected from the picture group which is to be proc- 10 
essed and is encoded by said representative picture 
coding means, and generates the signal including 
the motion parameters encoded by said coding 
means, and 

when said representative picture is selected 15 
from said representative picture storing means, said 
signal generating means generates the signal 
including the identifier of the representative picture 
which is selected from the representative picture 
storing means, and generates the signal including 2 o 
the motion parameters encoded by said coding 
means. 

24. A picture coding apparatus according to claim 21, 

22 or 23, wherein ' 25 

said signal generating means (17) generates 
the signal including said coding information relating 
to the representative picture and coding information 
indicating significance of the representative picture. 

25. A picture decoding apparatus comprising: 

representative picture extracting means 
(102) for extracting information relating to all or part 
of the representative pictures, from the signal gen- 
erated by the signal generating means (1 7) of said 35 

picture coding apparatus according to claim 21 22 

23 or 24; and 

representative picture decoding means (104) 
for decoding the representative picture extracted by 
said representative picture extracting means. 40 

26. A picture decoding apparatus comprising: 

input means for receiving the signal gener- 
ated by the signal generating means (1 7) of said pic- 
ture coding apparatus according to claim 23 ; 45 

judging means for judging whether or not the 
signal received by said input means includes the 
representative picture which is encoded by said rep- 
resentative picture coding means (15); 

representative picture decoding means (1 04) so 
for, when said judging means judges that the signal 
received by said input means includes the repre- 
sentative picture which is encoded by said repre- 
sentative picture coding means (15), decoding the 
representative picture and for sending the decoded 55 
representative picture to an output means; 

representative picture storing means (106) 
for storing the representative picture decoded by 
said representative picture decoding means (104); 



and 

said representative picture decoding means 
(104) for. when said judging means judges that the 
signal received by said input means does not include 
the representative picture which is encoded by said 
representative picture coding means (15), selecting 
the representative picture corresponding to the iden- 
tifier of the representative picture included in the sig- 
nal received by said input means, from said 
representative picture storing means (106), and for 
sending the selected representative picture to said 
output means. 

27. A picture decoding apparatus comprising: 

input means for receiving the signal gener- 
ated by the signal generating means (1 7) of said pic- 
ture coding apparatus according to claim 24; 

significance judging means (1 22) for extract- 
ing the coding information indicating the significance 
of the representative picture from the signal received 
by said input means, and judging whether or not the 
representative picture included in the signal 
received by said input means is to be decoded, on 
the basis of the coding information indicating the sig- 
nificance; 

representative picture decoding means (104) 
for, when said significance judging means (122) 
judges that the representative pcture included in the 
signal received by said input means is to be 
decoded, decoding the representative picture, and 
for sending the decoded representative picture to an 
output means, said representative picture being 
encoded by said representative picture coding 
means (15); 

representative picture storing means (106) 
for storing the representative picture decoded by 
said representative picture decoding means (104); 
and 

representative picture extracting means 
(102) for, when said significance judging means 
(1 22) judges that the representative picture included 
in the signal received by said input means is to be 
decoded, extracting the representative picture cor- 
responding to the identifier of the representative pic- 
ture, from said representative picture storing means 
(106), and for sending the extracted representative 
picture to said output means, said signal including 
the identifier of the representative picture. 



28. A picture decoding apparatus comprising: 

input means for receiving the signal gener- 
ated by the signal generating means (1 7) of said pic- 
ture coding apparatus according to claim 23; 

judging means forjudging whether or not the 
signal received by said input means includes the 
representative picture which is encoded by said rep- 
resentative picture coding means (15); 

representative picture decoding means (1 04) 
for. when said judging means judges that the signal 



29 




EP0 711 078 A2 



received by said input means includes the repre- 
sentative picture which is encoded by said repre- 
sentative picture coding means (15), decoding the 
representative picture and for sending the decoded 
representative picture joan output means; 5 

■jgprflypnfafivp picture storing means (106)" 
for storing the representative picture decoded by 
said representative picture decoding means (104); 

motion parameter selectively extracting 
means (132) for selectively extracting the motion 10 
parameter from the signal received by said input 
means, in accordance with a predetermined crite- 
rion; 

motion compensating means (134) for, when 
said judging means judges that the signal received 15 
by said input means includes the representative pic- 
ture which is encoded by said representative picture 
coding means (15), motion-compensating the 
motion parameter selectively extracted by said 
motion parameter selectively extracting means 20 
(132) on the basis of the representative picture 
decoded by said representative picture decoding 
means (104), thereby generating a predicted pic- 
ture, and, when said judging means judges that the 
signal received by said input means does not include 2 s 
the representative picture which is encoded by said 
representative picture coding means (15), motion- 
compensating the motion parameter selectively 
extracted by said motion parameter selectively 
extracting means (132) on the basis of the repre- 30 
sentative picture which is obtained from said repre- 
sentative picture storing means (106) and 
corresponds to the identifier included in the signal 
received by said input means, thereby generating 
the predicted picture; and 35 

decoded signal generating means (136) for 
generating a decoded signal with using the pre- 
dicted picture generated by said motion compensat- 
ing means (134) and/or the representative picture 
used for the predicted picture. ^ 
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